Next Article in Journal
Impact of Surgical Lights on the Performance of Fluorescence-Guided Surgery Systems: A Pilot Study
Previous Article in Journal
Effect of Corn Grinding Methods and Particle Size on the Nutrient Digestibility of Chahua Chickens
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Contextualized Small Target Detection Network for Small Target Goat Face Detection

1
College of Electronic Information Engineering, Inner Mongolia University, Hohhot 010020, China
2
State Key Laboratory of Reproductive Regulation and Breeding of Grassland Livestock, Hohhot 010020, China
3
Department of Electronic Engineering, College of Information Science and Engineering, Fudan University, Shanghai 200438, China
4
College of Information Engineering, Inner Mongolia University of Science and Technology, Baotou 014010, China
*
Authors to whom correspondence should be addressed.
Animals 2023, 13(14), 2365; https://doi.org/10.3390/ani13142365
Submission received: 29 June 2023 / Revised: 16 July 2023 / Accepted: 17 July 2023 / Published: 20 July 2023
(This article belongs to the Section Small Ruminants)

Abstract

:

Simple Summary

Goat identification is highly demanded in modern livestock management, and sheep face detection is an important basis for goat identification, for which we developed a new computer model that overcomes the challenges of unclear images, small targets, and low resolution. By considering the surrounding details and combining different features, our model performs better than existing methods in detecting goat faces. We used various evaluation metrics to measure its effectiveness and found a significant improvement in accuracy. The results confirmed that our method successfully addresses the difficulty of detecting lamb faces. This study has important implications for the development of intelligent management systems for modern livestock farms to better identify and monitor goat for improved animal welfare.

Abstract

With the advancement of deep learning technology, the importance of utilizing deep learning for livestock management is becoming increasingly evident. goat face detection provides a foundation for goat recognition and management. In this study, we proposed a novel neural network specifically designed for goat face object detection, addressing challenges such as low image resolution, small goat face targets, and indistinct features. By incorporating contextual information and feature-fusion complementation, our approach was compared with existing object detection networks using evaluation metrics such as F1-Score (F1), precision (P), recall (R), and average precision (AP). Our results show that there are 8.07%, 0.06, and 6.8% improvements in AP, P, and R, respectively. The findings confirm that the proposed object detection network effectively mitigates the impact of small targets in goat face detection, providing a solid basis for the development of intelligent management systems for modern livestock farms.

1. Introduction

The rapid development of deep learning has provided transformative abilities for computer vision, and its application provides new directions for accomplishing tasks such as image feature extraction and recognition. Changes in computer vision and artificial intelligence technologies have led to the application of target detection technologies in a wide range of industries. Computer vision has gained wide applications in the field of face recognition, and its applications in personal identification and information verification are very fast and efficient. Agriculture 4.0 is furthering the application of deep learning methods in all areas of animal husbandry [1], and the implementation of individual goat identification helps with individual behavior analyses [2,3], disease prevention [4], and the precise management of goats [5]. Since faces contain rich textural information as well as unique facial features, are unique and universal, and are relatively easy to capture, facial detection is of high research value as an application of deep learning in agriculture and provides the basis for subsequent recognition and classification tasks.
Guo [6] was able to achieve 91.1% accuracy by using Faster R-CNN to detect primate faces, and then using Tri-attention to recognize the detected images. Hitelman [7] used the Faster R-CNN algorithm to locate the face of a goat in an image, analyzed and compared this using several classification models and migration learning methods, and finally obtained an accuracy of 97% using the ResNet 50 V2 model with ArcFace loss function. Li [8] et al. demonstrated that Vision Transformer can be applied to sheep facial recognition and proposed a lightweight MobileViTFace model combined with MobileNetV2, which can reach 97.13% accuracy.
Due to the habits of goats and the limitations of pasture monitoring, the captured goat face targets are usually small and clustered, which makes goat face target detection very difficult. There are several methods for small-target detection, as follows:
Supplementary contextual information, which can compensate the problem of limited features being extracted from small targets by supplementing the network with more contextual information related to small targets [9]. Leng et al. [10] developed a new inner and outer recurrent neural network (IENET) and designed a bi-directional feature fusion module (BI-FFM), a contextual inference module (CRM), and a contextual feature enhancement module (CFAM). FASSD [11] obtained contextual information by adding a feature fusion module to SSD and combining this with the attention module to improve the detection of small targets.
With respect to super-resolution techniques, Li [12] first proposed a perceptual GAN model for small target detection, which employs a deep residual network as a generator that enables super-resolution display and captures more details.
Loss functions are beneficial for the class-balancing of small objects and Liu et al. [13] proposed a new feedback-driven loss function that trains the model in a more balanced manner by feeding back information about the loss distribution.
In our goat face small-target dataset, the following difficult points needed to be resolved.
(a)
The image resolution is too low, lacking sufficient feature information for recognition, and environmental factors can easily affect the detection effect;
(b)
The number of positive samples for small targets is small and, when the boundary between the Anchor set by the model and the small target is large, the number of positive training samples for small targets will be much smaller than the number of positive samples for large targets; the model is prone to ignore the detection of small targets, especially when the target object spans a large scale;
(c)
When performing feature fusion, the small target information is easily lost due to the small target features, which are easily overwhelmed by background noise.
To solve the above difficulties, we proposed a Contextualized Small Target Detection Network (CSTDNet). The main aspects of our network are as follows:
(i)
A Contextual Information Detection Module (CIDM) was proposed, which can provide more background information and further contextual information about the target, which can help in the detection of small targets;
(ii)
A Feature Complementary Module (FCM) was proposed to fuse the information of each scale while eliminating noise and interference, thus improving the reliability and anti-interference abilities of the feature target;
(iii)
WH-CIoU was proposed on the basis of CIoU, which can calculate the difference between the predicted frame width and height relative to their true values. The loss function is more biased to the change in the prediction frame size, which is more favorable to the regression of the prediction frame.

2. Materials and Methods

This section introduces the definition of small targets and the network model used to perform small-target detection.

2.1. Small Target Definition

The definitions of small targets are divided into two categories according to the scale and size of the target objects: relative definition and absolute definition. Relative definition means that the size of the target is smaller than a certain percentage of the original dataset image; for example, the small-target objects in the Stanford Drone dataset [14] are smaller than 0.2% of the original image size and the median value of the relative area (the ratio of the area of the bounding box to the area of the image) of the defined small target in the PASCAL-VOC dataset [15] is less than 5%. The absolute definition specifies that the pixels of the target must be less than a certain value to be defined as a small target, such as the AI-TOD [16] dataset, which defines 8–16 pixels as a tiny target and 16–32 pixels as a small target; the DIOR [17] dataset defines the width or height of a small target as less than 50 pixels.
Based on specific applications and research scenarios, different definitions of small targets have been given by researchers for specific datasets. Referring to the face detection dataset WIDER FACE [18], which defines the scale of small targets for faces as 10–50 pixels, and the daily items SDOD-MT [19] dataset, which similarly defines the range of small targets as 10–50 pixels depending on the length of the horizontal bounding box, we specified that targets must be smaller than 50 pixels in the goat face dataset to be classified as small-target goat faces.

2.2. Network Architecture Design

The development of deep learning has allowed for target detection networks to excel in the field of target recognition, and the YOLO algorithm is a typical one-stage target detection algorithm. In this study, we used YOLOV7 [20] as the backbone network, aiming to improve it and achieve the target detection of goat faces.

2.2.1. YOLOV7-Based Network Architecture

The YOLOV7 network model is an improved target detection network based on the YOLOV5 [21] optimization, using a feature pyramid FPN + PAN structure to fuse features from different feature layers, which is beneficial for feature extraction. The network uses the SPPCSPC module; the SPP module obtains different perceptual fields by maximum pooling, which can increase the perceptual field and allow the algorithm to adapt to different resolution images. The CSP module first divides the features into two parts, one of which is processed conventionally while the other is processed by the SPP structure, and later merges the two parts, which can reduce the computation time by half. This enables the speed to become faster and the accuracy to be improved. In terms of sample assignment strategy, YOLOV7 combines the positive and negative sample assignment strategies in YOLOV5 and YOLOX [22], which can provide more accurate prior knowledge.

2.2.2. Network Structure

The network structure (Figure 1) of this paper consists of backbone, neck and prediction. Backbone is the same as the backbone part of YOLOV7, and the neck part consists of a contextual information detection module, feature-fusion complementary module, and other modules, which will be described in detail below. The detection head in prediction is the same as that in YOLOV7, using three YOLO heads for detection. Since the detection type is only one category of goat face, the shape of the three feature layers in the detection head are (20, 20, 18), (40, 40, 18), and (80, 80, 18). The last shape of 18 can be split into three sixes, corresponding to the six parameters of the three prior boxes, while six can be split into four + one + one. Four is the regression parameter of each feature point, and adjusting the regression parameter can obtain the prediction framework; the first one determines whether each feature point contains an object, and the second one determines the feature category, because there is only one category, so it is one.

2.3. Context Information Detection Module

The detection of small goat face targets presents a formidable challenge due to multiple factors. Notably, acquired goat face targets exhibit blurriness, inconspicuous features, and considerable environmental interference. Furthermore, these small goat face targets typically occupy only a few pixels within the overall image, further exacerbating their susceptibility to noise, texture, and other disruptive factors. Consequently, accurately identifying and locating these small targets becomes arduous. To address the issue of substantial interference and the resulting low detection accuracy in goat face small target detection, we proposed a contextual information detection module. This module leverages the contextual information surrounding the target, enabling the acquisition of additional background information and contextual semantic cues. By incorporating such contextual information, the proposed module offers tangible benefits for the detection and localization of small targets.
We used a dilated convolution with different convolution rate sizes to form different receptive fields and extract local contextual information. As shown in the local context extraction backbone in Figure 2, a multi-branch convolutional block exists, in which each branch will extract information from different perceptual fields. We used dilated convolution with convolutional rates of 1, 2, 3, and 4 to extract information; to extract more information, the convolutional kernel size was increased to  3 × 3 , and the extracted information was fused by a cat operation to form local contextual information.
F 2 = C A T ( C o n v ( k = 3 , p = i , r = i ) ( F 2 ) ) , i = 1 , 2 , 3 , 4 ,
where  C A T ( · )  is concatenation and  C o n v ( k = 3 , p = i , r = i ) ( · )  is the dilated convolution with different convolution rates.
Local contextual information often exists in a feature layer. In order to obtain global contextual information in the surrounding environment, it is necessary to combine feature information from adjacent feature layers; therefore, we introduced feature interactions between features at adjacent levels and, since the previous and subsequent features have different scales to the current feature, the two adjacent branches were, respectively, upsampled and downsampled after convolution to align the number of channels. Then, the extraneous information generated in the feature interactions was suppressed by the ECA attention module [23] to reduce the sensitivity to noise and interference.
F 1 = C o n v ( E C A ( U p ( F 1 ) ) ) ,
F 3 = C o n v ( E C A ( D o w n ( F 3 ) ) ) ,
where  U p ( · )  and  D o w n ( · )  are upsampling and downsampling operations, respectively, and  E C A ( · )  is the ECA attention mechanism, an efficient attention module.
The final output is F,
F = F 1 + F 2 + F 3 .

2.4. Feature Complementary Module

To fuse the feature maps generated at the different stages, we proposed FCM-U and FCM-D, as shown in Figure 3. FCM-U aggregates the three features generated by the contextual information detection module and SPPCSPC and aligns the number of channels to improve the feature resolution and generate a new feature map in FCM-D to fuse the features generated in the previous stage. In FCM-U and FCM-D, we used convolution kernels of 3, 5, and 7 for dilation convolution to receive the correct number of channels for feature alignment, and then divided these two by two into UP or DOWN modules to improve and reduce the feature resolution. Finally, a differencing operation was performed to fuse the features and suppress the background noise generated during feature-fusion by differencing.
As shown in Figure 4, the high-resolution feature  f 1  is downsampled by averaging pooling to obtain  d o w n ( f 1 ) , and the low-resolution feature  f 2  is upsampled by bilinear interpolation to obtain  u p ( f 2 ) u p ( f 2 )  and  d o w n ( f 1 )  are then convolved  3 × 3  to obtain  C o n v ( d o w n ( f 1 ) )  and  C o n v ( u p ( f 2 ) ) , respectively. The convolved  C o n v ( f 2 )  is multiplied by  C o n v ( d o w n ( f 1 ) )  to obtain the feature  f 12 .
f 12 = C o n v ( d o w n ( f 1 ) ) × C o n v ( f 2 ) .
Similarly, multiply the convolved  C o n v ( f 1 )  with  C o n v ( u p ( f 2 ) )  to obtain the feature  f 21 .
f 21 = C o n v ( u p ( f 2 ) ) × C o n v ( f 1 ) .
Finally, the upsampled  f 12  is  u p ( f 12 )  passed through the convolution block and multiplied with the convolved  f 21 C o n v ( f 21 )  to obtain the output feature. The operation can be expressed as follows:
f f i n a l 1 = C o n v ( f 21 ) × C o n v ( u p ( f 12 ) ) .
The down module is similar to the up module;as shown in Figure 5 the only difference is that, instead of upsampling  f 12 f 21  is downsampled  d o w n ( f 21 )  through the convolution block and multiplied through the convolution block with  f 12  to obtain the output features. The operation is given in the following equation:
f f i n a l 2 = C o n v ( f 12 ) × C o n v ( d o w n ( f 21 ) ) .
After  u p  or  d o w n , the output features are set after the differential module to output the final feature results. The differential module can effectively offset noise and interference, thus improving the reliability and anti-interference ability of the feature target. The equation is as follows:
d i f f e r e n c e = F A F B .
F A F B  are the output of the previous stage and  ·  is the absolute value operation.
O U T = C A T ( d i f f e r e n c e 1 , d i f f e r e n c e 2 ) ;
d i f f e r e n c e 1  and  d i f f e r e n c e 2  are the outputs of difference in Figure 3, respectively, while  C A T ( · )  is a concatenation operation.

2.5. Small-Target Detection Head and Loss Function

The anchor frame sizes of YOLOV7 were set to 12, 16, 19, 36, 40, 28, 36, 75, 76, 55, 72, 146, 142, 110, 192, 243, 459, and 401, which are very scientific for target detection but not suitable for our small-target goat face detection. In order to set the anchor frame at an appropriate size, we first performed a cluster analysis on the training set anchor frame size using the clustering algorithm. The maximum target to be detected was revealed to be 55 and the minimum was 8. Most of the edge labels of the target to be detected were concentrated from 24 to 32; therefore, we set the anchor frame sizes as 5, 9, 12, 16, 19, 36, 42, 31, 40, 28, 55, 48, 36, 75, 76, 55, 72, and 146 to improve the detection accuracy for small targets.
The values of the loss function of YOLOV7 include target confidence loss, category confidence loss, and coordinate regression loss.
L o s s = 0.1 × L C o n + 0.125 L C l a + 0.05 × L L o c .
Binary cross entropy is a common loss function used here to calculate confidence loss and category loss.
L C o n = L C l a = B C E L o s s = 1 N ω × ( g t × l n ( p r ) + ( 1 g t ) × l n ( 1 p r ) ) .
The localization loss  L L o c  can be calculated using  I o U  [24],  G I o U  [25],  D I o U  [26], and  C I o U   [27] for loss calculation. IoU is the most commonly used metric in target detection, and can be used to evaluate the distance between the prediction frame and the ground true. The  I o U  formula is as follows:
I o U = g t p r g t p r .
G I o U  differs from  I o U  in that it can focus on non-overlapping regions, and the  G I o U  formula is as follows:
G I o U = I o U A c g t p r A c .
D I o U  can focus on the distance, overlap and scale of the target and anchor; the equation of  D I o U  is as follows:
D I o U = I o U ρ 2 ( p p r , p g t ) d 2 .
C I o U  is the addition of the detection box scale loss to  D I O U C I o U  is as follows:
C I o U = I o U ρ 2 ( p p r , p g t ) d 2 α v ,
where  g t  represents the ground-truth value,  p r  represents the prediction frame, and  A c  represents the area of the smallest closure region that contains both the prediction frame and the ground truth frame,  p p r  represents the centroid of the predicted frame,  p g t  represents the centroid of the ground truth frame,  ρ  is the Euclidean distance between the centroids of the truth frame and the predicted frame, d represents the minimum value of the diagonal of the region containing both the predicted frame and the ground truth frame,  α  is the weight function, and v is the parameter used to measure the consistency of the aspect ratio, which is given by the following equation:
α = v ( 1 I o U ) + v
v = 4 π 2 ( a r c t a n ( w g t h g t ) a r c t a n ( w p r h p r ) ) 2 ,
where  w g t h g t  represents the aspect ratio of the ground truth frame and  w p r h p r  represents the aspect ratio of the predicted frame.
C I o U  takes into account the difference in the bounding box width-to-height ratio instead of the difference between the predicted box and the ground truth box width and height truth, which can hinder the model regression in some cases. When  w g t h g t  = w p r h p r : when the predicted box width–height ratio is equal to the ground true box width–height ratio, the value of the  α v term of  C I o U  is 0, which means that its penalty term will be useless and will degrade to  D I o U . Based on the above, our  C I o U  was based on the proposed  W H C I o U , the width–height ratio was split and the variance in width and height relative to their true values were calculated separately, which can directly obtain the minimum value of the difference, which is more conducive to model convergence, and the  W H C I o U  formula is as follows:
W H C I o U = I o U ρ 2 ( p p r , p g t ) d 2 β ϵ
β = ϵ ( 1 I o U ) + ϵ .
ϵ  is as follows:
ϵ = 2 π 2 ( ( a r c t a n w p r w g t π 4 ) 2 ( a r c t a n h p r h g t π 4 ) 2 ) .
w p r w g t  is the ratio of the width of the prediction box to the width of the ground true box,  h p r h g t  is the ratio of the height of the prediction box to the height of the ground true box.
L L o c = 1 I o U / G I o U / D I o U / C I o U / W H I o U .
The individual IoUs were compared in the Section 3.

3. Experiments

This section describes the dataset used for the experiment, the evaluation metrics, and the results of the experiment.

3.1. Goat Face Image Dataset

In this paper, Albasian velvet goats were used as the test subjects and the data were collected in a pasture in Ordos, in the Inner Mongolia Autonomous Region in 2022. A 12-megapixel cell phone was used to shoot the video, with a frame size of 1920 pixels × 1080 pixels and a rate of 30 frames per second.
The test scenes included various scenes, such as goat barns and grasslands, and data were collected from hundreds of Albasian velvet goats. The data collection time range covered multiple time periods from 6:00 to 18:00 with different lighting conditions. The collected data covered different goat face images with different angles, and different poses were collected. The captured video was divided into independent goat images using the frame-splitting operation and one image was taken every 30 frames during the frame-splitting operation in order to prevent the appearance of overly similar images in the database.
After that, the images were filtered to keep high-quality images, remove blurred images, and remove images with high similarity. Filtered images were labeled with the goat faces using the Pascal VOC 2007 data format to complete the Albasian goat dataset, and then filtered by the clustering algorithm to remove the images containing goat faces larger than 50 pixel values. The images containing goat faces larger or smaller than 50 pixel values were then filtered by the clustering algorithm—the obtained target contained targets with 50 pixel values and below—and the small-target dataset of goat faces was obtained for our training.As in Figure 6 The dataset contained 8871 images with 65,894 goat faces.
We used the Mosaic data augmentation method [28] and Mixup data augmentation method [29] to process the dataset.As in Figure 7, the mosaic data augmentation method can generate new training data by randomly combining multiple images. This method randomly scales, crops, and randomly distributes four images and then randomly stitches them into one large mosaic graph. This processing method can better enrich the dataset, while random scaling adds more small targets and makes the network more robust. The Mixup data enhancement method can generate new training data by randomly and linearly combining two different images. Specifically, it linearly mixes two images in a certain ratio to obtain a new image and linearly mixes their labels in the same ratio to obtain a new pair of labels.

3.2. Experimental Evaluation Metrics

To evaluate the performance of the proposed model more fairly and accurately, this paper used precision (P), recall (R), F1-Score( F 1 ), and  A P  for the performance evaluation and comparison [30]. The formulae for each metric used in this paper are presented below:
  • Precision (P): This indicator describes the proportion of positive samples detected by the model that are actually positive. The larger the value, the higher the accuracy rate, which would ideally be 1:1:
    P = T P T P + F P .
  • Recall (R): This indicator describes the proportion of correct positive samples detected by the model among all positive samples:
    R = T P T P + F N .
  • F1-Score: This indicator combines precision and recall and takes a balanced value for a comprehensive assessment of:
    F 1 = 2 × P × R P + R .
  • AP: AP is the average precision, which is the area under the precision–recall curve:
    A P = 0 1 P ( R ) d R ,
    where  T P  is the number of samples that are actually positive and predicted to be positive,  F P  is the number of samples that are actually negative but predicted to be positive, and  F N  is the number of samples that are actually positive but predicted to be negative.
Our goat face detection used bounding boxes to represent the position and size of the goat face.  I o U  is a method for measuring the position of bounding boxes, used to evaluate the degree of overlap between predicted and real bounding boxes, ranging from 0 to 1, where 1 represents complete overlap. Setting a certain threshold and retaining the bounding box can achieve the function of the detection of goat faces. The threshold used in this study was 0.7.

3.3. Test Environment and Network Parameter Settings

The designed model was trained using the Windows 10 64-bit operating system; the framework used for deep learning was PyTorch, the programming language was Python, and the computer had 16 GB of RAM with an AMD Ryzen 7 5800H with a Radeon Graphics processor and an NVIDIA GeForce RTX 3060 graphics card to accelerate image processing. The model was trained using batch training, with hyperparameters set to eight image samples per batch and an initial learning rate of 1 × 10 4 . Using the ADAMW optimizer, the network model was operated to save weights every 10 completed iterations for a total of 100 iterations.

3.4. Comparison Experiments

To verify the accuracy of the models by comparison, we collected eight models that use achieved advanced methods in the field of target detection for comparison, including CenterNet [31], EfficientDet [32], SSD [33], FASSD [11], FCOS [34], RetinaNet [35], YOLOV5 [21], and V7 [20] of the same YOLO series. To ensure fairness in the experiments, we used source code as well as source evaluation methods for the experiments. The following Table 1 shows the experimental results of our proposed model and the comparison model for goat face detection.
Table 1 shows the best results obtained for goat face detection compared to the other detection models; AP improved by 8.07%, F1 improved by 0.06, and recall improved by 6.8%. In the statistical test section, we evaluated different algorithmic models using the Friedman test and the Nemenyi test to compare the performance of different methods on P, R, F, and AP metrics. We chose five models with excellent test performance to compare with our model. First, we made an assumption of model equality, named H. Table 1 shows the ranking results of these six models for different metrics. We calculated the chi-square value as  χ 2  = 14.429 and the p-value as p = 0.013 < 0.05. This indicates that the models show statistically significant differences between them. By performing the Nemenyi test, we can calculate the critical distance CD = 3.770. From this result, we can infer that our model CSTDNet is significantly different and performs better than SSD, YOLOV5. The effectiveness of CSTDNet for small target goat face detection was verified by comparing several methods through statistical tests. Table 2 shows the ranking of small target detection results based on comparative test data.
In the face of practical use, the image, in addition to the small target goat face, will also appear as a normal-sized goat face. In order to ensure the completeness of the experiment, while verifying the generalization ability of the model proposed in this paper, in the small target goat face test set after the normal-sized goat face test set was constructed once again, the size of the small target goat face data test set was the same as that of the normal-sized goat face test set, at 1006 sheets. Tests were performed on the constituent datasets, and the test results are shown in Table 3 below:
From Table 3, we can see that YOLOV7 is better than our model at normal size target detection, but our model still outperforms most of the models, which shows that ours possesses good generalization, outperforms YOLOV7 in small target detection, and achieves an approximately similar performance in normal size detection.
Similar to small target detection, the same Friedman test and Nemenyi test were used to evaluate six models, including ours, for normal-sized target detection. Table 4 shows the results of ranking these six models on different metrics for normal target detection. We calculated a chi-square value of  χ 2  = 18.813 and a p-value of p = 0.002 < 0.05. This indicates that there are statistically significant differences between the models. In the Nemenyi test, we calculated the critical distance, CD = 3.770, by which it can be inferred that our model CSTDNet is not significantly different from YOLOV7. A comparison of several methods using statistical tests verified that CSTDNet is equally effective in the detection of normal-sized goat face targets. Table 4 shows the ranking of normal-sized target detection results based on comparative test data.
In Figure 8, the loss graphs obtained for each network on the goat face dataset are presented. As shown in Figure 8, our modified loss converged faster in the overall detection process, in addition to having a greater compensation mechanism for the detection of small targets.

3.5. Ablation Experiments

To demonstrate the effectiveness of the proposed modules of this model, ablation experiments were conducted and the evaluation dataset for the ablation experiments used the goat face dataset. The experimental results are shown in Table 5. We used YOLOV7 (base) and backbone as a baseline. Row 2 (backbone + CIDM) is shown to outperform row 1 (backbone), where AP increases by 3.52%. In addition, the third row outperforms the first row (backbone), where AP increases by 5.73%, respectively. To investigate whether the combination of the CIDM and the FCM plays a role in this, we looked at row 4 (backbone + CIDM + FCM), which shows the highest performance of all settings, with an improvement of 8.07%.
For the statistical evaluation of the ablation experiments, we also used the same methodology described above, and Table 6 shows the sorting results of the different modules in comparison with the backbone. A chi-square value of  χ 2  = 12 and a p-value of p = 0.007 < 0.05 were obtained. This indicates that the individual modules present statistically significant differences between them. With the Nemenyi test, we calculated the critical distance, CD = 2.345, from which we can infer that our overall model CSTDNet is significantly different and performs better than backbone, verifying the validity of each module of CSTDNet. Table 6 shows the ranking of test results according to ablation test data.
Figure 9 shows the results of goat face recognition for both our method and YOLOV7. The first column is the image to be detected; the second column is Grouth True; the third and fourth columns are our and YOLOV7’s prediction results. It can be seen that our method accurately detects goat faces, and YOLOV7 suffers from some missed detections and a low detection frame IoU. This shows that, in comparison, our model can better detect small targets and is very accurate.

4. Discussion

This study aimed to use deep learning techniques to solve the problem of difficult localization and detection of goat faces in real livestock farm environments. First, we constructed a dataset of Alba velvet goat facial images and then developed a small target goat face detection network model. However, there are still some challenges and limitations to be addressed.
First, compared with other animals, goats have fewer facial texture features, which makes their face detection more susceptible to interference, such as complex sampling environments, lighting conditions, and different goat poses. This poses a challenge for accurately detecting goat faces in realistic scenarios. In addition, the lack of publicly available standardized datasets for goat face detection limits the evaluation and comparison of different detection methods. Future research should focus on constructing comprehensive and representative datasets specifically for goat face detection.
Furthermore, although our study demonstrated good results for goat facial detection, it is critical to apply our method to other goat species and validate its performance. Different goat species may exhibit differences in facial characteristics, and further investigation and adaptation of the detection model is needed to ensure its validity across different goat populations.
Practical applications of goat facial detection also need to consider challenges such as occlusion and different environmental conditions. Accurate detection of goat faces under partially obscured or challenging lighting conditions remains an important area for future improvement.
While this research helps advance goat face detection using deep learning, it is critical to address the above limitations and challenges. Further research should focus on developing robust detection models that can handle variations in facial features, incorporate different datasets, and address challenges encountered in real-world livestock management scenarios. These advances will help develop intelligent management systems that enhance the identification, tracking, and welfare of goat in modern livestock farms.

5. Conclusions

The experimental results show that the detection accuracy is low on small-target goat faces when directly using traditional target detection algorithms. In this paper, we proposed a goat face detection model that combines contextual information and feature-fusion complementary modules to solve the above problem. By using the target’s contextual information to provide more background and semantic information, and fusing the feature maps generated at different stages, the model performance is significantly improved and shows good robustness, reducing the impact of small targets in goat face target detection and providing a basis for the subsequent development of the intelligent management of goat in modern pastures.

Author Contributions

Conceptualization, Y.W. and L.W.; Methodology, D.H.; Software, D.H.; Validation, Y.W. and Y.G.; Formal Analysis, Y.G.; Investigation, Y.W.; Resources, D.H.; Data Curation, Y.W.; Writing—Original Draft Preparation, D.H. and Y.G.; Writing—Review & Editing, H.D.; Visualization, L.W.; Supervision, L.W.; Project Administration, Y.G.; Funding Acquisition, H.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the National Key R&D Program of China (Grant No. 2022YFF1300604-04), the Major Science and Technology Project of Inner Mongolia Autonomous Region (Grant No. 2021ZD0019-4), and the Scientific Research Project of Higher Education Institutions in Inner Mongolia Autonomous Region (Grant No. NJZY22337).

Institutional Review Board Statement

Ethical review and approval were waived for this study because the study only set up the image acquisition device in an inaccessible area of the goat, there was no substantial contact with the goat, and the image acquisition device had no impact on animal health, so there were no ethical or moral implications for this study.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Neethirajan, S. The role of sensors, big data and machine learning in modern animal farming. Sens. Bio-Sens. Res. 2020, 29, 100367. [Google Scholar] [CrossRef]
  2. Nobrega, L.; Tavares, A.; Cardoso, A.; Goncalves, P. Animal monitoring based on IoT technologies. In Proceedings of the 2018 IoT Vertical and Topical Summit on Agriculture—Tuscany (IOT Tuscany), Tuscany, Italy, 8–9 May 2018; pp. 1–5. [Google Scholar]
  3. Guo, Y.; He, D.; Chai, L. A Machine Vision-Based Method for Monitoring Scene-Interactive Behaviors of Dairy Calf. Animals 2020, 10, 190. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Li, L.; Dong, J.; Song, X.; Nie, L.; Zhang, S.; Liu, M. Research on Goat Health Management System. In Proceedings of the International Workshop on Intelligent Systems & Applications, Wuhan, China, 28–29 May 2011. [Google Scholar]
  5. He, D.; Liu, D.; Zhao, K. Review of perceiving animal information and behavior in precision livestock farming. Trans. Chin. Soc. Agric. Mach. 2016, 47, 231–244. [Google Scholar]
  6. Guo, S.; Xu, P.; Miao, Q.; Shao, G.; Chapman, C.A.; Chen, X.; He, G.; Fang, D.; Zhang, H.; Sun, Y.; et al. Automatic identification of individual primates with deep learning techniques. Iscience 2020, 23, 101412. [Google Scholar] [CrossRef] [PubMed]
  7. Hitelman, A.; Edan, Y.; Godo, A.; Berenstein, R.; Lepar, J.; Halachmi, I. Biometric identification of sheep via a machine-vision system. Comput. Electron. Agric. 2022, 194, 106713. [Google Scholar] [CrossRef]
  8. Li, X.; Xiang, Y.; Li, S. Combining convolutional and vision transformer structures for sheep face recognition. Comput. Electron. Agric. 2023, 205, 107651. [Google Scholar] [CrossRef]
  9. Oliva, A.; Torralba, A. The role of context in object recognition. Trends Cogn. Sci. 2007, 11, 520–527. [Google Scholar] [CrossRef] [PubMed]
  10. Leng, J.; Ren, Y.; Jiang, W.; Sun, X.; Wang, Y. Realize Your Surroundings: Exploiting Context Information for Small Object Detection. Neurocomputing 2021, 433, 287–299. [Google Scholar] [CrossRef]
  11. Lim, J.S.; Astrid, M.; Yoon, H.; Lee, S.I. Small Object Detection using Context and Attention. In Proceedings of the 2021 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Jeju Island, Republic of Korea, 13–16 April 2021; pp. 181–186. [Google Scholar]
  12. Li, J.; Liang, X.; Wei, Y.; Xu, T.; Feng, J.; Yan, S. Perceptual Generative Adversarial Networks for Small Object Detection. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 1951–1959. [Google Scholar]
  13. Liu, G.; Han, J.; Rong, W. Feedback-driven loss function for small object detection. Image Vis. Comput. 2021, 111, 104197. [Google Scholar] [CrossRef]
  14. Robicquet, A.; Sadeghian, A.; Alahi, A.; Savarese, S. Learning Social Etiquette: Human Trajectory Understanding in Crowded Scenes; Springer International Publishing: Cham, Switzerland, 2016. [Google Scholar]
  15. Everingham, M.; Van Gool, L.; Williams, C.; Winn, J.; Zisserman, A. The Pascal Visual Object Classes (VOC) Challenge. Int. J. Comput. Vis. 2010, 88, 303–338. [Google Scholar] [CrossRef] [Green Version]
  16. Wang, J.; Yang, W.; Guo, H.; Zhang, R.; Xia, G.S. Tiny Object Detection in Aerial Images. In Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy, 10–15 January 2021. [Google Scholar]
  17. Li, K.; Wan, G.; Cheng, G.; Meng, L.; Han, J. Object detection in optical remote sensing images: A survey and a new benchmark. ISPRS J. Photogramm. Remote Sens. 2020, 159, 296–307. [Google Scholar] [CrossRef]
  18. Yang, S.; Luo, P.; Loy, C.C.; Tang, X. WIDER FACE: A Face Detection Benchmark. In Proceedings of the IEEE Conference on Computer Vision & Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016; pp. 5525–5533. [Google Scholar]
  19. Ji, Z.; Kong, Q.; Wang, H.; Pang, Y. Small and Dense Commodity Object Detection with Multi-Scale Receptive Field Attention. In Proceedings of the 27th ACM International Conference, Nice, France, 21–25 October 2019. [Google Scholar]
  20. Wang, C.Y.; Bochkovskiy, A.; Liao, H.Y.M. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv 2022, arXiv:2207.02696. [Google Scholar]
  21. Jocher, G.; Chaurasia, A.; Stoken, A.; Borovec, J.; Kwon, Y.; Michael, K.; Fang, J.; Yifu, Z.; Wong, C.; Montes, D.; et al. Ultralytics/YOLOv5: V7. 0-YOLOv5 SOTA Realtime Instance Segmentation; Zenodo: Geneva, Switzerland, 2022. [Google Scholar]
  22. Ge, Z.; Liu, S.; Wang, F.; Li, Z.; Sun, J. YOLOX: Exceeding YOLO Series in 2021. arXiv 2021, arXiv:2107.08430. [Google Scholar]
  23. Wang, Q.; Wu, B.; Zhu, P.; Li, P.; Hu, Q. ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. In Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 16–18 June 2020. [Google Scholar]
  24. Yu, J.; Jiang, Y.; Wang, Z.; Cao, Z.; Huang, T. Unitbox: An advanced object detection network. In Proceedings of the 24th ACM International Conference on Multimedia, Amsterdam, The Netherlands, 15–19 October 2016; pp. 516–520. [Google Scholar]
  25. Rezatofighi, H.; Tsoi, N.; Gwak, J.; Sadeghian, A.; Reid, I.; Savarese, S. Generalized intersection over union: A metric and a loss for bounding box regression. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019; pp. 658–666. [Google Scholar]
  26. Zheng, Z.; Wang, P.; Liu, W.; Li, J.; Ye, R.; Ren, D. Distance-IoU loss: Faster and better learning for bounding box regression. In Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA, 9–11 February 2020; Volume 34, pp. 12993–13000. [Google Scholar]
  27. Du, S.; Zhang, B.; Zhang, P.; Xiang, P. An improved bounding box regression loss function based on CIOU loss for multi-scale object detection. In Proceedings of the 2021 IEEE 2nd International Conference on Pattern Recognition and Machine Learning (PRML), Chengdu, China, 16–18 July 2021; pp. 92–98. [Google Scholar]
  28. Bochkovskiy, A.; Wang, C.Y.; Liao, H.Y.M. YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv 2020, arXiv:2004.10934. [Google Scholar]
  29. Zhang, H.; Cisse, M.; Dauphin, Y.N.; Lopez-Paz, D. mixup: Beyond Empirical Risk Minimization. arXiv 2020, arXiv:1710.09412. [Google Scholar]
  30. Zhang, X.; Xuan, C.; Xue, J.; Chen, B.; Ma, Y. LSR-YOLO: A High-Precision, Lightweight Model for Sheep Face Recognition on the Mobile End. Animals 2023, 13, 1824. [Google Scholar] [CrossRef]
  31. Duan, K.; Bai, S.; Xie, L.; Qi, H.; Huang, Q.; Tian, Q. CenterNet: Keypoint Triplets for Object Detection; 2019. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019; pp. 6569–6578. [Google Scholar]
  32. Tan, M.; Pang, R.; Le, Q.V. EfficientDet: Scalable and Efficient Object Detection. In Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 16–18 June 2020. [Google Scholar]
  33. Liu, W.; Anguelov, D.; Erhan, D.; Szegedy, C.; Reed, S.; Fu, C.Y.; Berg, A.C. Ssd: Single shot multibox detector. In Proceedings of the Computer Vision—ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, 11–14 October 2016; Proceedings, Part I 14. Springer: Berlin/Heidelberg, Germany, 2016; pp. 21–37. [Google Scholar]
  34. Tian, Z.; Shen, C.; Chen, H.; He, T. FCOS: Fully Convolutional One-Stage Object Detection. In Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea, 27 October–2 November 2019. [Google Scholar]
  35. Lin, T.Y.; Goyal, P.; Girshick, R.; He, K.; Dollár, P. Focal Loss for Dense Object Detection. In Proceedings of the 2017 IEEE/CVF International Conference on Computer Vision (ICCV), Venice, Italy, 22–29 October 2017; pp. 6569–6578. [Google Scholar]
Figure 1. Contextualized Small-Target Detection Network (CSTDNet). The CIDM1 in the figure is a CIDM without the line1 in Figure 2.
Figure 1. Contextualized Small-Target Detection Network (CSTDNet). The CIDM1 in the figure is a CIDM without the line1 in Figure 2.
Animals 13 02365 g001
Figure 2. Context information detection module.
Figure 2. Context information detection module.
Animals 13 02365 g002
Figure 3. Feature complementary module.
Figure 3. Feature complementary module.
Animals 13 02365 g003
Figure 4. FCM-Up.
Figure 4. FCM-Up.
Animals 13 02365 g004
Figure 5. FCM-Down.
Figure 5. FCM-Down.
Animals 13 02365 g005
Figure 6. Small target goat face dataset.
Figure 6. Small target goat face dataset.
Animals 13 02365 g006
Figure 7. Mosaic data augmentation and Mixup data augmentation.
Figure 7. Mosaic data augmentation and Mixup data augmentation.
Animals 13 02365 g007
Figure 8. Loss function.
Figure 8. Loss function.
Animals 13 02365 g008
Figure 9. Predicted results.
Figure 9. Predicted results.
Animals 13 02365 g009
Table 1. Comparison of experimental results.
Table 1. Comparison of experimental results.
ModuleP (%)R (%)F1AP (%)
CenterNet [31]88.0252.360.6671.51
EfficientDet [32]95.5522.00.3639.77
SSD [33]89.4547.420.5757.28
FASSD [11]98.4121.90.3536.36
FCOS [34]84.8063.560.7374.69
RetinaNet [35]94.3717.550.3031.40
YOLOV5 [21]84.4751.220.6363.45
YOLOV7 [20]85.7169.130.7777.9
Ours90.4275.930.8385.97
Bold is the maximum value in a single column.
Table 2. Ranking of small target detection results based on comparative test data.
Table 2. Ranking of small target detection results based on comparative test data.
ModulePRF1APAverage
CenterNet [31]34443.75
SSD [33]26665
FCOS [34]53333.5
YOLOV5 [21]65555.25
YOLOV7 [20]42222.5
Ours11111
Table 3. Normal target comparison experimental results.
Table 3. Normal target comparison experimental results.
ModuleP (%)R (%)F1AP (%)
CenterNet [31]88.6253.700.6772.83
EfficientDet [32]95.6024.570.3942.13
SSD [33]88.0249.480.6371.73
FASSD [11]92.4131.170.4648.52
FCOS [34]93.0290.030.9294.04
RetinaNet [35]94.6919.850.3333.79
YOLOV5 [21]90.7676.730.8386.51
YOLOV7 [20]95.1389.470.9495.72
Ours94.5288.750.9294.59
Bold is the maximum value in a single column.
Table 4. Ranking of normal-sized target detection results based on comparative test data.
Table 4. Ranking of normal-sized target detection results based on comparative test data.
ModulePRF1APAverage
CenterNet [31]65555.25
SSD [33]56665.75
FCOS [34]312.532.375
YOLOV5 [21]44444
YOLOV7 [20]12111.25
Ours232.522.375
Table 5. Results of ablation experiments.
Table 5. Results of ablation experiments.
ModuleP(%)R(%)F1AP(%)
backbone85.7169.130.7777.9
backbone + CIDM88.7873.170.881.42
backbone + FCM88.8474.220.8283.63
backbone + CIDM + FCM90.4275.930.8385.97
Bold is the maximum value in a single column.
Table 6. Ranking of test results according to ablation test data.
Table 6. Ranking of test results according to ablation test data.
ModulePRF1APAverage
backbone44444
backbone + CIDM33333
backbone + FCM22222
backbone + CIDM + FCM11111
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, Y.; Han, D.; Wang, L.; Guo, Y.; Du, H. Contextualized Small Target Detection Network for Small Target Goat Face Detection. Animals 2023, 13, 2365. https://doi.org/10.3390/ani13142365

AMA Style

Wang Y, Han D, Wang L, Guo Y, Du H. Contextualized Small Target Detection Network for Small Target Goat Face Detection. Animals. 2023; 13(14):2365. https://doi.org/10.3390/ani13142365

Chicago/Turabian Style

Wang, Yaxin, Ding Han, Liang Wang, Ying Guo, and Hongwei Du. 2023. "Contextualized Small Target Detection Network for Small Target Goat Face Detection" Animals 13, no. 14: 2365. https://doi.org/10.3390/ani13142365

APA Style

Wang, Y., Han, D., Wang, L., Guo, Y., & Du, H. (2023). Contextualized Small Target Detection Network for Small Target Goat Face Detection. Animals, 13(14), 2365. https://doi.org/10.3390/ani13142365

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop