Next Article in Journal
An Autonomous Thermal Camera System for Monitoring Fumarole Activity
Next Article in Special Issue
Grape Maturity Estimation Using Time-of-Flight and LiDAR Depth Cameras
Previous Article in Journal
Concurrent Supra-Postural Auditory–Hand Coordination Task Affects Postural Control: Using Sonification to Explore Environmental Unpredictability in Factors Affecting Fall Risk
Previous Article in Special Issue
Multimodal Mobile Robotic Dataset for a Typical Mediterranean Greenhouse: The GREENBOT Dataset
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Crop Leaf Phenotypic Parameter Measurement Based on the RKM-D Point Cloud Method

1
School of Water Resources and Hydropower, Xi’an University of Technology, Xi’an 710054, China
2
Department of Water Resources of Xinjiang Uygur Autonomous Region, Urumqi 830099, China
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(6), 1998; https://doi.org/10.3390/s24061998
Submission received: 19 January 2024 / Revised: 26 February 2024 / Accepted: 19 March 2024 / Published: 21 March 2024
(This article belongs to the Special Issue Robotics and Sensors Technology in Agriculture)

Abstract

:
Crop leaf length, perimeter, and area serve as vital phenotypic indicators of crop growth status, the measurement of which is important for crop monitoring and yield estimation. However, processing a leaf point cloud is often challenging due to cluttered, fluctuating, and uncertain points, which culminate in inaccurate measurements of leaf phenotypic parameters. To tackle this issue, the RKM-D point cloud method for measuring leaf phenotypic parameters is proposed, which is based on the fusion of improved Random Sample Consensus with a ground point removal (R) algorithm, the K-means clustering (K) algorithm, the Moving Least Squares (M) method, and the Euclidean distance (D) algorithm. Pepper leaves were obtained from three growth periods on the 14th, 28th, and 42nd days as experimental subjects, and a stereo camera was employed to capture point clouds. The experimental results reveal that the RKM-D point cloud method delivers high precision in measuring leaf phenotypic parameters. (i) For leaf length, the coefficient of determination (R2) surpasses 0.81, the mean absolute error (MAE) is less than 3.50 mm, the mean relative error (MRE) is less than 5.93%, and the root mean square error (RMSE) is less than 3.73 mm. (ii) For leaf perimeter, the R2 surpasses 0.82, the MAE is less than 7.30 mm, the MRE is less than 4.50%, and the RMSE is less than 8.37 mm. (iii) For leaf area, the R2 surpasses 0.97, the MAE is less than 64.66 mm2, the MRE is less than 4.96%, and the RMSE is less than 73.06 mm2. The results show that the proposed RKM-D point cloud method offers a robust solution for the precise measurement of crop leaf phenotypic parameters.

1. Introduction

Phenotypic parameters such as leaf length, perimeter, and area are crucial indicators of crop growth dynamics [1]. The leaf length reflects the crop growth status and guides irrigation strategies, while the leaf perimeter and area correlate with photosynthetic efficiency and yield [2,3,4,5]. Across growth stages, leaf phenotypic parameters exhibit distinct trends. In the initial weeks after germination, leaves experience rapid growth, followed by a maturation phase with slower growth rates. Eventually, the leaf length, perimeter, and area reach their maximum values before potential wilting occurs [6].
Variations in leaf phenotypic parameters across growth stages are essential for understanding crop growth patterns, management strategies, and yield enhancement opportunities.
(1)
Point cloud processing method
Three-dimensional (3D) point clouds facilitate the non-invasive measurement of leaf phenotypic parameters, offering advantages over manual and two-dimensional (2D) methods [7,8,9,10,11]. However, original 3D plant point clouds often include irrelevant ground and noise points, complicating accurate parameter measurements [12].
Ground removal, segmentation, and smoothing are essential for improving measurement precision [12]. Traditional ground point cloud removal methods, such as statistical and bilateral filtering, may encounter challenges due to the unpredictable nature of noise points in pepper growth environments [13,14].
Segmentation methods such as the Mean Shift and the K-means algorithm address spatial distribution and geometric properties. While the Mean Shift excels in handling clusters of varying shapes, K-means demonstrates a rapid convergence speed [15,16].
Smoothing techniques such as filtering and Moving Least Squares (MLS) aim to enhance the point cloud quality. Combining filtering and MLS methods can effectively mitigate noise and preserve target features [17,18].
Overall, addressing challenges in point cloud processing, segmentation, and smoothing is crucial for robust and adaptive applications.
(2)
Methods for measuring phenotypic parameters
Beyond point cloud processing, selecting suitable methods for measuring crop phenotypic parameters is crucial for robust analysis.
While traditional manual measurements are simple and do not require complex equipment, their processes are susceptible to human error and are limited in scope. In contrast, methods based on image processing offer efficiency and scalability for large-scale measurements; however, they demand strict environmental conditions, with lighting and capture angles potentially affecting the measurement accuracy. Recently, there has been an adoption of deep learning for measuring leaf phenotypic parameters, which exhibits strong adaptability to complex scenarios. Nonetheless, it comes with notable drawbacks, requiring extensive annotated data and long model training cycles and posing potential issues with generalization. Methods utilizing three-dimensional point clouds for phenotypic parameter measurements are also prevalent, offering richer spatial information to capture the three-dimensional structure of leaves; however, their point cloud processing procedures are intricate.
To be specific, the Oriented Bounding Box (OBB) method is commonly used for length, width, and height measurements, but it has limitations with small and curved targets such as leaves [19,20]. UAV remote sensing and structured light projection methods offer alternatives for three-dimensional structural information extraction but have limitations such as field of view constraints and sensitivity to environmental factors.
In consideration of the challenges posed by complex three-dimensional pepper leaf point cloud processing and less precise measurements of phenotypic parameters, in this paper, a novel leaf phenotypic parameter measurement method based on point clouds is proposed, termed RKM-D, which integrates point cloud spatial properties, color characteristics, and Euclidean distance. Tailored point cloud processing methods and leaf phenotypic parameter measurement techniques are proposed to address specific requirements. Validation and analysis against manually measured results confirm the effectiveness of the proposed approach, offering a robust theoretical foundation for related research and applications.

2. Materials and Methods

2.1. Experimental Design

The experiment focused on three pepper plants, selected as experimental subjects, across three growth stages: the 14th, 28th, and 42nd days. Seventy-two point clouds were collected for each leaf. The LenaCV stereo camera system (Wuhan Lina machine Vision Technology Co., Ltd., Wuhan, China) was employed to comprehensively capture the raw point cloud data.
As shown in Figure 1, for every pepper plant, the point cloud data were collected at three heights: above (No. 1), middle (No. 2), and below (No. 3). During the collection process, the camera rotated relative to the central axis of the pepper plant, collecting a point cloud dataset every 15 degrees in the circumference of the pepper plant. Therefore, approximately 72 point cloud sets were collected for each pepper plant in each period.

2.2. Point Cloud Acquisition Method

As shown in Figure 1, after the collection of each point cloud set, all the point cloud sets were formed into a coarse pepper point cloud using a combination of the wavelet layered filtering method and the homogeneous feature matching method. The denoising of point clouds was achieved through the utilization of wavelet transforms. Specifically, the point cloud data were transformed to generate a series of wavelet coefficients, which were then used to determine the validity of the point cloud [21]. Subsequently, a uniform feature matching method was employed to identify similar features within the point cloud, thereby aggregating multiple point clouds into a rough point cloud, serving as the preliminary registration result [22]. Finally, the original pepper point cloud was obtained by using the ICP registration method [23].

2.3. Point Cloud Processing Method

2.3.1. RANSAC-B-Based Ground Points Removal

For the removal of the ground cloud points of the original pepper point cloud, we propose an enhanced Random Sample Consensus algorithm with ground point removal (RANSAC-B); the process flow for the RANSAC-B method is listed as follows.
Step 1. Spatial filtering. Firstly, the ground points set is distinguished from the original point cloud using the proposed spatial filtering with a color threshold. This step helps to isolate the ground points with colors not associated with the pepper plant, as shown in Figure 2.
Step 2. Bounding box. Secondly, the max boundary six directions, front ( p f ), back ( p b ), left ( p l ), right ( p r ), up ( p u ), and down ( p d ), are identified by employing the maximum sorting algorithm. Based on the six directional boundary points, a bounding box can be formed with all of the ground points enclosed.
Step 3. Key vertices. Thirdly, the key vertices of the identified bounding box are the two diagonal vertices that represent its geometric parameters— p 1 x m a x , y m i n , z m i n and p 2 x m i n , y m a x , z m a x , for example.
Step 4. Ground point removal. Finally, the RANSAC algorithm is employed to remove the invalid ground points within the identified bounding box.
The RANSAC algorithm is applied as follows:
Let Ω represent the point cloud space of the background frame, and let all points within Ω constitute the point set P R . We randomly select the first group of three sample points p 1 , p 2 , p 3 P R . Subsequently, we determine the plane equation formed by p 1 , p 2 , p 3 as A i x + B i y + C i z + D i = 0 . Next, we substitute the remaining points from point set P R (excluding the sampled points) into the plane equation, and calculate the distance d R from each point to the plane using Equation (1). Following this, we compare d R with the distance threshold d t R : if d R < d t R , the point is considered an inlier; if d R > d t R , the point is considered an outlier. This process is repeated, resulting in multiple sets of inlier and outlier points. The set with the highest number of inlier points is designated as the optimal point set. Based on the optimal point set, we obtain the optimal plane equation and filter out points in the point cloud. To determine an appropriate distance threshold d t R , we assess its impact on the fitting performance. By gradually increasing or decreasing the threshold, we aim to find a threshold that effectively distinguishes ground points.
d R = A i x 0 + B i y 0 + C i z 0 + D i A i 2 + B i 2 + C i 2 .

2.3.2. K-Means Based Segmentation

As for the segmentation of the pepper leaves from its point cloud, the K-means clustering method is employed. The steps and flowchart are depicted as follows.
Step 1. Use the elbow method to determine the optimal value of K as the number of segments for clustering segmentation [24]. Choose a range for K, run the K-means for each value, calculate aggregation metrics, and identify the optimal K from the elbow method graph (see Figure 3).
Step 2. Initialization. For the determined optimal K, initialize the clustering centers ( d k 0 ) using a random algorithm.
Step 3. Object Assignment. Assign each point cloud object to its nearest clustering center.
Step 4. Compute New Centroids. Calculate new centroid positions (dk) by averaging the points assigned to each cluster.
Step 5. Iterative Computation. Repeat Steps 3 and 4 iteratively until the convergence criteria ( d k d k 0 < θ ) are met.
Step 6. Algorithm Termination. If the convergence criteria are not met, continue iterating; otherwise, terminate the algorithm and output the final clustering results.
The initial cluster number is set to 5; the maximum cluster number is set to 30. The elbow method graph is constructed by plotting the within-cluster sum of squares for each K value. The horizontal axis represents the range of K values, and the vertical axis denotes the corresponding within-cluster sum of squares. The elbow position on the graph is identified as the point where the sharp decline in the aggregation metric transitions to a more gradual decrease. The K value associated with this elbow position is considered the optimal initial K value for our clustering analysis.

2.3.3. MLS-Based Point Cloud Smoothing

The MLS method is employed for point cloud smoothing, and the specific process can be summarized as follows (see Figure 4):
Step 1. Randomly select a point p from the pepper leaf point cloud.
Step 2. Define a spherical region B M with a radius R M centered at point p.
Step 3. Collect all points within the spherical region B M to form the point set P M .
Step 4. Use the Least Squares Surface Fitting method to fit a surface, C M , to all points in P M .
Step 5. Divide the point set P M into two groups: inliers (points within the fitted surface C M , depicted in blue) and outliers (points outside the fitted surface C M , depicted in black).
Step 6. Project all outliers from C M onto the surface of C M using the normal projection method, thereby smoothing the pepper leaf point cloud.

2.4. Euclidean-Distance-Based Phenotypic Parameter Measurement

2.4.1. Leaf Length

(1)
Manual leaf length measurement
The leaf is extended and a vernier caliper with a precision of 0.1 mm is employed to measure the length from the leaf tip to the leaf base, denoted as leaf length l a .
(2)
Euclidean-distance-based leaf length measurement
As depicted in Figure 5, the spatial point cloud surface of the leaf is set as S . Then, S is projected onto the horizontal plane in space, denoted as the xy plane, to obtain S , and the starting point p s is assigned at the leaf base and the ending point p d at the front end of the leaf in S . Next, p s and p d are connected to form a straight-line segment l s d . Subsequently, l s d is divided into n equal segments, with the i -th segment point p i . After that, the normal vector n is computed, proceeding from p s along l s d in the direction perpendicular to n , and the corresponding projection points p i are located within S for p i . Sequentially p s , p 1 ,…… , p n 1 and p d are connected to form line segments l 1 , l 2 , …… l n . Finally, the real leaf length l p can be calculated using Equation (2).
l p = μ 1 i = 1 n 1 l i
where l i is the estimated leaf length, μ 1 is the length scale, and n 1 is the number of segments.

2.4.2. Leaf Perimeter

(1)
Manual leaf perimeter measurement
Firstly, the obtained images are binarized, which are taken by laying the pepper leaf flat 30–50 cm below the camera. Secondly, the edge point of each binarized image is detected, and the pixel distance C i between adjacent points p i and p i + 1 is calculated. Thirdly, the perimeter measurement C a is performed.
C a = μ 2 i = 1 n 2 C i  
where μ 2 is the pixel length scale and n 2 is the total number of the edge points of the pepper leaf.
(2)
Euclidean-distance-based leaf perimeter measurement
In order to lessen the consumption of computing resources, uniform downsampling [25] is used to downsample the original point cloud S . The downsampled point cloud is labeled as S 1 and is subsequently utilized to apply an edge extraction algorithm [26], which is used to identify the boundary point set Ω 1 (see Figure 6).
Next, the Euclidean distance C p i between adjacent points in a clockwise direction along the set Ω 1 is calculated. Finally, the real leaf perimeter C p can be calculated using Equation (4).
C p = μ 1 i = 1 n 3 C p i
where n 3 is the number of boundary point line segments.

2.4.3. Leaf Area

(1)
Manual leaf area measurement
Firstly, a two-dimensional image of the leaf is captured from a precise position, 30 cm directly above the leaf’s central point. Subsequently, the image is binarized. Then, the black pixels representing the leaf area are accurately counted and used to calculate the area measurement S a .
S a = μ 3 i = 1 n 4 S i
where μ 3 is the pixel area scale and n 4 is the total number of leaf pixels.
(2)
Euclidean-distance-based leaf area measurement
For pepper leaf area calculation, surface reconstruction is performed using the point cloud, employing the Ball Pivoting algorithm [27] for triangular meshing. A starting triangle is randomly selected as the starting triangle T s . A sphere B A with a radius R A is defined, which contacts the three vertices of T s . Starting from any edge a T s of the starting triangle T s , the sphere B A is rotated in space. When B A encounters a new point, a new triangle is created by connecting the edge a T s with the new point. This process is repeated until all points in the point cloud have been visited, as illustrated in Figure 7.
In this method, defining the sphere radius R A is a crucial step in surface reconstruction. If the R A is too small, the rolling sphere may pass through gaps in the point cloud without finding new points, resulting in holes in the reconstructed surface, as depicted in Figure 8a. To address this issue and reduce the occurrence of holes during reconstruction, the number of input rolling spheres was increased to 4, with radii ranging from 2 to 5. During the reconstruction process, smaller spheres were employed in dense point cloud regions, while larger spheres were used in sparse point cloud areas for triangulating the surface. The results are illustrated in Figure 8b, demonstrating a more complete reconstruction compared to the situation depicted in Figure 8a.
In Figure 8c, local triangulation is performed. The area of each triangle is calculated based on its vertices, denoted as S i . The sum surface area S p is calculated using Equation (6).
S p = μ 4 i = 1 n 5 S i
where μ 4 is the point cloud area scale and n 5 is the total number of triangular meshing.

3. Results and Discussion

In accordance with the previously outlined methodology, the comprehensive procedure is depicted in Figure 9.

3.1. Point Cloud Acquisition

As described in Section 2.2, the images were captured using a stereo camera, followed by filtering and stereo matching to obtain the original point cloud. Subsequently, the point clouds preprocessed at different periods, as illustrated in Figure 10, and underwent ICP registration [23] and uniform downsampling [25] with a sampling radius of 20. The respective point cloud numbers were 53,487, 47,356, and 125,690.

3.2. RKM-B-Based Point Cloud Processing

The point cloud preprocessing method, which incorporates the improved Random Sample Consensus (RANSAC-B), K-means, and Moving Least Squares techniques, is collectively referred to as RKM-B, in contrast to the unmodified RKM method. Comprehensive processing using the RKM-B method is illustrated in Figure 11.
In the ground point removal stage, N G represents the total number of point clouds in the background box, while N θ denotes the number of stem point clouds in the ground box and is calculated using Equation (7).
N θ = π r 2 h ρ p o i n t
where r is the stem radius, h is the background box height, and ρ p o i n t is the number of stem point clouds per unit volume.
In the leaf segmentation stage, the similarity coefficient D s (Equation (8)) is introduced to compare the similarity between clustered segmentation results and actual leaves [28]. A segmentation threshold D θ is determined based on empirical considerations, and for leaf quantities ranging from 0 to 10, the coefficient D θ is assigned a value of 0.88. In the case of leaf quantities between 11 and 25, D θ takes a value of 0.84. Furthermore, when the leaf quantity surpasses 25, D θ is set to 0.80.
D s = 2 × L K L R L K + L R
where L K is the number of point clouds identified and L R is the number of point clouds in actual leaves.
Leaf smoothing is determined based on the volume ratio V R of the minimum bounding box of the leaf point cloud. The maximum volume ratio V m a x is set at 0.9, while the minimum value V m i n is designated as 0.7.
Utilizing the RANSAC-B algorithm introduced in Section 2.3.1, the results are illustrated in Figure 12.
Continuing from ground point removal, leaf segmentation is implemented using the method outlined in Section 2.3.2, as depicted in Figure 13. In Figure 13b, the point cloud is segmented into eight clusters, each representing an individual leaf, while the stem is divided into two clusters.
Following leaf segmentation, individual leaves display fluctuation errors and uneven contours in the side view of the point cloud, indicating significant undulations. The outcomes, post-application of the smoothing method described in Section 2.3.3, are illustrated in Figure 14.
The smoothness ρ i of a single leaf is defined according to [29] as Equation (9). An average angle of 30° corresponds to a smoothness value of 0.033, while a 45° angle corresponds to a smoothness value of 0.022. The larger the smoothness value, the smaller the average angle.
ρ i = 1 1 m a = 1 m 1 20 b = 1 20 φ a , b
where i denotes the i -th leaf, φ a , b represents the angle between the normal vectors of point a and its neighboring 20 points b , and m is the total number of points in the point cloud.
The average smoothness of each leaf is computed using Equation (10).
ρ ¯ = i = 1 n 1 n ρ i
where n is the total number of leaves at a specific period.
Considering the results of the aforementioned processing, a comparative analysis was conducted, examining the RKM-B processing method and the untreated dataset concerning differences in the point cloud number, leaf smoothness, algorithmic execution time, and other aspects. Table 1 succinctly presents the comprehensive results of this comparative assessment.
From Table 1, it can be seen that the total time consumption as well as “R” and “K” are significantly reduced in the three periods. However, for “M”, the changes are gentle, and in some instances, there is even a time increase, particularly on the 42nd day. This is because ground point removal has no impact on the quantity and morphological features of leaf point clouds, resulting in no sharp change in the time consumption for “K.” Contrarily, for “R,” the time gradually increases with the growth of crops. This is due to the easier differentiation between ground points and stems as the leaves expand, leading to a reduction in interference. However, for “K,” the reduction in time diminishes as the crops grow. This is due to the increase in the number of points involved in segmentation as the peppers grow, leading to a decrease in the reduction in processing time. The total reduction in time stabilizes at around 2 s, but the baseline processing time continues to increase with crop growth.
From the perspective of smoothness, the increases in smoothness for the leaves at the three growth periods are 0.003, 0.004, and 0.002, corresponding to average angle reductions of 2.7°, 6.1°, and 3.5°, respectively. Compared to the untreated smoothness, both “RKM-B” and “RKM” exhibit significant improvements in smoothness. The baseline smoothness gradually decreases across the three growth periods. This outcome is attributed to the relatively smaller size and minimal shape changes in the leaves at the 14th day of growth, resulting in a predominantly flat leaf surface. As the leaves grow, at the 28th day and 42nd day of growth, the leaves become more fully developed, gradually presenting certain curved angles in space.

3.3. Leaf Length Measurement

Leaf lengths, denoted as l a and l p , are presented separately for the 14th, 28th, and 42nd days in Figure 15. It is evident that l a and l p exhibit a linear relationship.
The R2 values for leaf length are all above 0.81 across various pepper growth periods. Moreover, the R2 tends to increase with both leaf growth and the number of leaves.
The MAE values for leaf length are 2.57 mm, 3.34 mm, and 3.35 mm, showing a slight increase with leaf growth. After the first measurement period, the MAE stabilizes, with the maximum value not exceeding 3.50 mm.
The RMSE values are 2.90 mm, 3.63 mm, and 3.72 mm, respectively.
Throughout the experiment, the obtained MRE remains less than 5.93%, with MRE values of 5.13%, 5.92%, and 4.65% for different periods.
From Figure 16, it can be observed that the leaf length gradually increases over the three periods, with average values of 49.12 mm, 57.24 mm, and 74.94 mm. This trend is attributed to the chosen measurement periods, all of which are in the early stages of pepper development, where leaf growth is rapid and new leaves are continuously generated. By examining the growth increment of leaf length, it was found that the increment in the third period was greater than that in the second period. This phenomenon may be due to an increase in leaf quantity, intensifying the overall physiological activities of the crop and resulting in a higher demand for resources. Consequently, a larger increase in leaf length is observed during the third measurement period.

3.4. Leaf Perimeter Measurement

The leaf perimeters, denoted as C a and C p , for the three periods are illustrated in Figure 17.
The R2 values were 0.82, 0.97, and 0.95, respectively. The lower R2 during the first measurement period is attributed to the smaller number of leaves.
The MAE for the pepper leaf perimeter was 5.04 mm, 6.17 mm, and 7.20 mm, indicating an increase in the average absolute error with leaf development, with larger errors observed in the later periods of leaf growth.
The RMSE exhibited a similar trend to the MAE, with values of 5.97 mm, 7.77 mm, and 8.36 mm, respectively.
Throughout the experiments, the MRE remained less than 4.50%, with values of 4.41%, 4.48%, and 4.30%, respectively.
The trend in the leaf perimeter and its increment is generally similar to that of the leaf length. From Figure 18, it can be observed that the average values of the leaf perimeter over the three periods were 109.5 mm, 132.4 mm, and 171.5 mm. It is noteworthy that the leaf perimeter increment on the 42nd day exhibits greater fluctuations compared to leaf length. This could be attributed to different parts experiencing varying growth rates, with the growth rate at the leaf margin potentially influenced by local environmental conditions, nutrient distribution, or genetic regulation, leading to uneven leaf perimeter growth.

3.5. Leaf Area Measurement

Linear regression analyses were conducted using manual measurement values S a and RKM-D measured values S p , as depicted in Figure 19. The results presented are for three measurement periods.
The R2 values were 0.98, 0.99, and 0.99, all surpassing 0.97. This indicates a significant correlation between the calculated values from the pepper area point cloud and manual measurements.
The MAE for the pepper leaf area was 24.59 mm2, 39.35 mm2, and 64.65 mm2, respectively. The MAE increases with leaf development, with larger absolute errors observed in the later periods of leaf growth. The first measurement period exhibits the smallest average absolute error in leaf area, while the third measurement period shows the largest, reaching a maximum value of 64.65 mm2.
The RMSE follows a trend similar to the MAE, with values of 27.07 mm2, 44.94 mm2, and 73.05 mm2, respectively.
Throughout the experiments, the MRE remained less than 4.96%, with small variations, at 4.33%, 4.95%, and 4.76%, respectively.
The overall trend in the leaf area and its increment is similar to the leaf length and perimeter. Over the three periods, the average values of the leaf area gradually increase (see Figure 20), measuring 601.4 mm2, 914.5 mm2, and 1358.6 mm2, respectively. However, unlike the leaf length and perimeter, the measurement of the leaf area shows a relatively higher correlation coefficient during the first measurement period. This is primarily because, when dealing with irregularly shaped leaves, the leaf area, as a comprehensive measure of the overall leaf size, can mitigate the measurement inaccuracies caused by local errors, thus enhancing the overall measurement correlation.

4. Conclusions

This paper presents a novel method for measuring crop leaf phenotypic parameters, named RKM-D. Using peppers as the representative research subject, manual measurements and RKM-D point cloud measurements were conducted on the 14th, 28th, and 42nd days of pepper growth. The results demonstrate a strong linear relationship between the proposed RKM-D method and the ground truth, with minimal parameter errors.
The RKM-D method includes preprocessing steps such as ground point removal using RANSAC-B, leaf segmentation using K-means, and leaf smoothing using MLS. Additionally, the method incorporates a phenotype measurement approach for the pepper leaf length, perimeter, and area based on Euclidean distance.
Specifically, for leaf length measurements, the R2 values exceed 0.81, the MAE is less than 3.50 mm, the MRE is less than 5.93%, and the RMSE is less than 3.92 mm. For the leaf perimeter, the R2 exceeds 0.82, the MAE is less than 9.10 mm, the MRE is less than 4.50%, and the RMSE is less than 11.27 mm. Leaf area measurements show R2 values exceeding 0.98, an MAE less than 85.58 mm2, an MRE less than 4.96%, and an RMSE less than 3.92 mm2.
This method proves effective in achieving accurate phenotypic measurements of pepper leaves, providing valuable insights for research on pepper leaf phenotypic parameters.
Furthermore, future research will focus on three main aspects: extending leaf measurements across multiple time points to establish growth curves, investigating environmental factors’ impact on plant growth for accurate assessments, and implementing advanced agricultural intelligence techniques for automated and intelligent plant monitoring. Through these efforts, we aim to comprehensively understand plant growth dynamics and contribute to the advancement of sustainable agriculture.

Author Contributions

Methodology, W.M.; conceptualization, M.D.; writing—original draft preparation, Y.L.; software, N.H.; data analysis, X.G. All authors have read and agreed to the published version of the manuscript.

Funding

Xinjiang Uygur Autonomous Region Major Science and Technology Special Projects (2022A02003-3, 2023A02002-4).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Zhang, H.; Wang, L.; Jin, X.; Bian, L.; Ge, Y. High-throughput phenotyping of plant leaf morphological, physiological, and biochemical traits on multiple scales using optical sensing. Crop J. 2023, 11, 1279–1610. [Google Scholar] [CrossRef]
  2. Yang, W.; Guo, Z.; Huang, C.; Wang, K.; Jiang, N.; Feng, H.; Chen, G.; Liu, Q.; Xiong, L. Genome-wide association study of rice (Oryza sativa L.) leaf traits with a high-through put leaf scorer. J. Exp. Bot. 2015, 66, 5605–5615. [Google Scholar] [CrossRef] [PubMed]
  3. Li, Z.; Guo, R.; Li, M.; Chen, Y.; Li, G. A review of computer vision technologies for plant phenotyping. Comput. Electron. Agric. 2020, 176, 105672. [Google Scholar] [CrossRef]
  4. Che, Y.; Wang, Q.; Xie, Z.; Li, S.; Zhu, J.; Li, B.; Ma, Y. High-quality images and data augmentation based on inverse projection transformation significantly improve the estimation accuracy of biomass and leaf area index. Comput. Electron. Agric. 2023, 212, 108144. [Google Scholar] [CrossRef]
  5. Chen, H.; Liu, S.; Wang, C.; Wang, C.; Gong, K.; Li, Y.; Lan, Y. Point Cloud Completion of Plant Leaves under Occlusion Conditions Based on Deep Learning. Plant Phenomics 2023, 5, 0117. [Google Scholar] [CrossRef] [PubMed]
  6. Zhang, Z.; Cao, H.; Pei, S.; Li, M. Optimum leaf based on photosynthesis and fluorescence parameters of pepper seedlings under drought stress. Agric. Res. Arid Areas 2022, 40, 33–40. [Google Scholar] [CrossRef]
  7. Hu, Y.; Wang, L.; Xiang, L.; Wu, Q.; Jiang, H. Automatic non-destructive growth measurement of leafy vegetables based on Kinect. Sensors 2018, 18, 806. [Google Scholar] [CrossRef] [PubMed]
  8. Wang, J.; Li, X.; Zhou, Y.; Wang, H.; Li, M. Banana Pseudostem Width Detection Based on Kinect V2 Depth Sensor. Comput. Intell. Neurosci. 2022, 2022, 10. [Google Scholar] [CrossRef]
  9. Wang, R.; Liu, D.; Wang, X.; Yang, H. Segmentation and measurement of key phenotype for Chinese cabbage sprout using multi-view geometry. Trans. Chin. Soc. Agric. Eng. 2022, 38, 243–251. [Google Scholar] [CrossRef]
  10. Boogaard, F.P.; van Henten, E.J.; Kootstra, G. The added value of 3D point clouds for digital plant phenotyping–A case study on internode length measurements in cucumber. Biosyst. Eng. 2023, 234, 1–12. [Google Scholar] [CrossRef]
  11. Li, Y.; Liu, J.; Zhang, B.; Wang, Y.; Yao, J.; Zhang, X.; Fan, B.; Li, X.; Hai, Y.; Fan, X. Three dimensional reconstruction and phenotype measurement of maize seedlings based on multi-view image sequences. Front. Plant Sci. 2022, 13, 974339. [Google Scholar] [CrossRef]
  12. Su, B.; Liu, Y.; Wang, Z.; Mi, Z.; Wang, F. Leaf Area Estimation Method Based on Three-dimensional Point Cloud. Trans. Chin. Soc. Agric. Mach. 2019, 50, 240–246, 254. [Google Scholar] [CrossRef]
  13. Yin, Y.; Wan, W.; Liu, R. Filtering outliers using statistical analysis on neighbors distance. IET Int. Conf. Smart Sustain. City 2013, 2013, 149–152. [Google Scholar] [CrossRef]
  14. Qian, X.; Ye, C. NCC-RANSAC: A Fast Plane Extraction Method for 3-D Range Data Segmentation. IEEE Trans. Cybern. 2014, 44, 2771–2783. [Google Scholar] [CrossRef]
  15. Peng, C.; Li, S.; Miao, Y.; Zhang, Z.; Zhang, M.; Li, H. Stem-leaf segmentation and phenotypic trait extraction of tomatoes using three-dimensional point cloud. Trans. Chin. Soc. Agric. Eng. 2022, 38, 187–194. [Google Scholar] [CrossRef]
  16. Guo, C.; Wang, X.; Shi, C.; Jin, H. Corn Leaf Image Segmentation Based on Improved Kmeans Algorithm. J. North Univ. China 2021, 42, 524–529. [Google Scholar] [CrossRef]
  17. Li, W.-L.; Xie, H.; Zhang, G.; Li, Q.-D.; Yin, Z.-P. Adaptive Bilateral Smoothing for a Point-Sampled Blade Surface. IEEE-ASME Trans. Mechatron. 2016, 21, 2805–2816. [Google Scholar] [CrossRef]
  18. Kang, C.; Shi, M.; Chen, Y.; Chen, J.; Zhang, L. A Smoothing De-noising Method Considering Multi-scale Noise. Sci. Technol. Eng. 2018, 18, 110–116. [Google Scholar] [CrossRef]
  19. He, J.Q.; Harrison, R.J.; Li, B. A novel 3D imaging system for strawberry phenotyping. Plant Methods 2017, 13, 93. [Google Scholar] [CrossRef] [PubMed]
  20. Xu, H.; Ma, S.; Wang, Y.; Hu, H.; Yin, J.; Che, J. Three-dimensional Estimation of Money Plant Leaf External Phenotypic Parameters Based on Geometric Model. Trans. Chin. Soc. Agric. Mach. 2020, 51, 220–228. [Google Scholar] [CrossRef]
  21. Jing, W.; Jie, J. Classification and denoising system for three-dimensional laser scanning point cloud data using wavelet transform technology. Autom. Instrum. 2023, 6, 35–39. [Google Scholar] [CrossRef]
  22. Dror, A.; Niloy, J.; Daniel, C. 4-Points Congruent Sets for Robust Pairwise Surface Registration. ACM Trans. Graph. 2008, 27, 1–10. [Google Scholar] [CrossRef]
  23. Besl, P.J.; Mckay, H.D. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 1992, 14, 239–256. [Google Scholar] [CrossRef]
  24. Kanungo, T.; Mount, D.M.; Netanyahu, N.S.; Piatko, C.D.; Silverman, R.; Wu, A.Y. An efficient k-means clustering algorithm: Analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24, 881–892. [Google Scholar] [CrossRef]
  25. Xiao, Z.; Gao, J.; Wu, D.; Zhang, L. A Uniform Downsampling Method for Three-Dimensional Point Clouds Based on Voxel Grids. Mach. Des. Manuf. 2023, 08, 180–184. [Google Scholar] [CrossRef]
  26. Han, Y.; Hou, H.; Bai, Y.; Zhu, X. A closed point cloud edge extraction algorithm using edge coefficient. Laser Optoeletronics Process 2018, 55, 155–160. [Google Scholar] [CrossRef]
  27. Bernardini, F.; Mittleman, J.; Rushmeier, H.; Silva, C.; Taubin, G. The ball-pivoting algorithm for surface reconstruction. IEEE Trans. Vis. Comput. Graph. 1999, 5, 349–359. [Google Scholar] [CrossRef]
  28. Rand, W.M. Objective Criteria for the Evaluation of Clustering Methods. J. Am. Stat. Assoc. 1971, 66, 846–850. [Google Scholar] [CrossRef]
  29. Sun, J.; Ding, Y.; Wang, N.; Xi, J.; Zhu, X. Identification Algorithm for Inner Surface of Bowl-shaped Broken Pieces Based on Point Cloud Proportion and Smoothness. J. Harbin Univ. Sci. Technol. 2020, 25, 157–161. [Google Scholar] [CrossRef]
Figure 1. Overview of data acquisition.
Figure 1. Overview of data acquisition.
Sensors 24 01998 g001
Figure 2. Ground point removal diagram.
Figure 2. Ground point removal diagram.
Sensors 24 01998 g002
Figure 3. Flowchart of the elbow method.
Figure 3. Flowchart of the elbow method.
Sensors 24 01998 g003
Figure 4. Overview of the MLS algorithm.
Figure 4. Overview of the MLS algorithm.
Sensors 24 01998 g004
Figure 5. Schematic diagram of the calculation of leaf length.
Figure 5. Schematic diagram of the calculation of leaf length.
Sensors 24 01998 g005
Figure 6. Overview of leaf perimeter acquisition.
Figure 6. Overview of leaf perimeter acquisition.
Sensors 24 01998 g006
Figure 7. Diagram of the triangulation.
Figure 7. Diagram of the triangulation.
Sensors 24 01998 g007
Figure 8. Triangle reconstruction results. (a) R A = 3; (b) R A = 2~5; (c) triangulated local.
Figure 8. Triangle reconstruction results. (a) R A = 3; (b) R A = 2~5; (c) triangulated local.
Sensors 24 01998 g008
Figure 9. Overview of the procedure.
Figure 9. Overview of the procedure.
Sensors 24 01998 g009
Figure 10. The preprocessed point cloud obtained at different periods. (a) The 14th day; (b) the 28th day; (c) the 42nd day.
Figure 10. The preprocessed point cloud obtained at different periods. (a) The 14th day; (b) the 28th day; (c) the 42nd day.
Sensors 24 01998 g010
Figure 11. Overview of the RKM-B method procedure.
Figure 11. Overview of the RKM-B method procedure.
Sensors 24 01998 g011
Figure 12. RANSAC-B ground point filtering. (a) Before processing; (b) after processing.
Figure 12. RANSAC-B ground point filtering. (a) Before processing; (b) after processing.
Sensors 24 01998 g012
Figure 13. Segmentation of pepper leaves. (a) Point cloud of pepper; (b) point cloud clustering results.
Figure 13. Segmentation of pepper leaves. (a) Point cloud of pepper; (b) point cloud clustering results.
Sensors 24 01998 g013
Figure 14. Schematic diagram of leaf smoothing treatment. (a) Original point cloud; (b) post-smoothed point cloud.
Figure 14. Schematic diagram of leaf smoothing treatment. (a) Original point cloud; (b) post-smoothed point cloud.
Sensors 24 01998 g014
Figure 15. Analysis of leaf length correlation. (a) the 14th day; (b) the 28th day; (c) the 42nd day.
Figure 15. Analysis of leaf length correlation. (a) the 14th day; (b) the 28th day; (c) the 42nd day.
Sensors 24 01998 g015
Figure 16. Leaf length versus incremental box plot.
Figure 16. Leaf length versus incremental box plot.
Sensors 24 01998 g016
Figure 17. Correlation analysis of leaf perimeter. (a) The 14th day; (b) the 28th day; (c) the 42nd day.
Figure 17. Correlation analysis of leaf perimeter. (a) The 14th day; (b) the 28th day; (c) the 42nd day.
Sensors 24 01998 g017
Figure 18. Leaf perimeter versus incremental box plot.
Figure 18. Leaf perimeter versus incremental box plot.
Sensors 24 01998 g018
Figure 19. Correlation analysis of leaf area across three different growth periods. (a) The 14th day; (b) the 28th day; (c) the 42nd day.
Figure 19. Correlation analysis of leaf area across three different growth periods. (a) The 14th day; (b) the 28th day; (c) the 42nd day.
Sensors 24 01998 g019
Figure 20. Leaf area versus incremental box plot.
Figure 20. Leaf area versus incremental box plot.
Sensors 24 01998 g020
Table 1. Comparison of the effects of methods in each period.
Table 1. Comparison of the effects of methods in each period.
PeriodTime Consuming (s) Smoothness   ρ ¯
RKMTotal
14th dayRKM1.581.410.523.510.032
RKM-B0.960.390.491.840.035
Original////0.029
28th dayRKM1.731.570.433.730.024
RKM-B0.970.560.411.620.028
Original////0.020
42nd dayRKM2.282.521.556.350.022
RKM-B0.731.791.594.110.024
Original////0.017
Notes: “Smoothness” is the average smoothness of individual leaf segments within each specified interval; “R” is RANSAC-B algorithm and RANSAC algorithm; “K” is K-means algorithm; “M” is MLS algorithm; “total” is the total running time; RKM is a combination of RANSAC, K-means, and MLS algorithms; RKM-B is a combination of RANSAC-B, K-means, and MLS algorithms; “Original” is the smoothness of the leaf without any treatment.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Mu, W.; Li, Y.; Deng, M.; Han, N.; Guo, X. Crop Leaf Phenotypic Parameter Measurement Based on the RKM-D Point Cloud Method. Sensors 2024, 24, 1998. https://doi.org/10.3390/s24061998

AMA Style

Mu W, Li Y, Deng M, Han N, Guo X. Crop Leaf Phenotypic Parameter Measurement Based on the RKM-D Point Cloud Method. Sensors. 2024; 24(6):1998. https://doi.org/10.3390/s24061998

Chicago/Turabian Style

Mu, Weiyi, Yuanxin Li, Mingjiang Deng, Ning Han, and Xin Guo. 2024. "Crop Leaf Phenotypic Parameter Measurement Based on the RKM-D Point Cloud Method" Sensors 24, no. 6: 1998. https://doi.org/10.3390/s24061998

APA Style

Mu, W., Li, Y., Deng, M., Han, N., & Guo, X. (2024). Crop Leaf Phenotypic Parameter Measurement Based on the RKM-D Point Cloud Method. Sensors, 24(6), 1998. https://doi.org/10.3390/s24061998

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop