Next Article in Journal
Iterative Regression Based Hybrid Localization for Wireless Sensor Networks
Next Article in Special Issue
Development of an Automated Optical Inspection System for Rapidly and Precisely Measuring Dimensions of Embedded Microchannel Structures in Transparent Bonded Chips
Previous Article in Journal
Reliable Time Propagation Algorithms for PMF and RBPMF
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Stamping Monitoring by Using an Adaptive 1D Convolutional Neural Network

Department of Mechanical Engineering, National Chin-Yi University of Technology, Taichung 41170, Taiwan
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(1), 262; https://doi.org/10.3390/s21010262
Submission received: 18 November 2020 / Revised: 27 December 2020 / Accepted: 29 December 2020 / Published: 2 January 2021

Abstract

:
Stamping is one of the most widely used processes in the sheet metalworking industry. Because of the increasing demand for a faster process, ensuring that the stamping process is conducted without compromising quality is crucial. The tool used in the stamping process is crucial to the efficiency of the process; therefore, effective monitoring of the tool health condition is essential for detecting stamping defects. In this study, vibration measurement was used to monitor the stamping process and tool health. A system was developed for capturing signals in the stamping process, and each stamping cycle was selected through template matching. A one-dimensional (1D) convolutional neural network (CNN) was developed to classify the tool wear condition. The results revealed that the 1D CNN architecture a yielded a high accuracy (>99%) and fast adaptability among different models.

1. Introduction

Stamping remains one of the most widely used processes in sheet metalworking and is the primary process in the manufacture of many products, such as automotive products, electronics, and medical devices. To ensure the consistent quality of the manufactured products, monitoring of the tools used in the stamping process is crucial. Therefore, monitoring data are required to clearly understand factors affecting the conditions of stamping tools [1].
Several studies have focused on monitoring the condition of tools that are used in machining processes such as drilling, turning, and milling; nevertheless, studies that have focused on monitoring the conditions of tools used in stamping processes are few, particularly those involving data acquisition and data recognition or classification. Several studies have proposed the use of force, strain, acoustic emission, vibration, and audio indicators for monitoring the stamping process. However, the analyses executed in these studies did not cover all monitoring processes; instead, such analyses were mostly centered on recognition, classification, or regression processes. Wu et al. [2] proposed using vibration signals to monitor the micropiercing process and logistic regression to predict damage. Sari et al. [3] used acoustic emission to monitor the micropiercing process online. Shanbhag et al. [4] investigated the galling wear of a stamping tool by evaluating acoustic emission frequency characteristics. Ge et al. [5] modeled monitoring signals at different periods in the stamping process by using several autoregressive models with residue as a feature, followed by classification by using the Hidden Markov Model. Tian et al. [6] used machine vision to detect tool surface defects engendered by the stamping and grinding of flat parts.
The strain signal is the most commonly used monitoring signal since it is proportional to the stamping force. However, strain sensors can identify only certain faults and cannot be applied to detect dynamic characteristics of the stamping operation, especially in the high frequency band [7]. On the other hand, AE and vibration force sensors are suitable for detection of the changes in the process and wear. Nevertheless, they are difficult to install and expensive. In terms of vibration sensors, they are easy to acquire and contain ample information about the process dynamics. Although problem of low signal and noise ratio was mentioned before, we applied PCB356A15 accelerometers with sensitivities of 100 mV/g in the present study to solve this issue and clear stamping signals were observed.
Vibration signals provide information crucial in determining dynamic behaviors at high frequencies in the stamping process [7]. Zhang et al. [8] used piezoelectric strain sensors to measure the strain on the press column surface through feature selection to monitor and detect failures in the punching process. Sari et al. [9] demonstrated the relationship between increasing the amplitude within a certain frequency range and the appearance of burrs and onset of damage that leads to punch failure. Continuous use of the tool can cause various problems, such as wear, variation in the quality of the product, and damage to the machine. Cutting tools usually exhibit adhesive and abrasive wear at contact zones [10]. Zhang et al. [11] used the bispectrum to analyze acceleration signals during the online stamping operation, which helped detect tool failure or tool wear.
Vibration signal data captured during the stamping process exhibit different patterns, which can be used to monitor tool health. Some studies have used various pattern matching methods [12,13,14,15] to process vibration signals; the present study implemented these methods for analysis. A template is required as a basis for capturing the vibration signals because different parameters could affect the shape of the signal pattern, resulting in patterns with varying shapes.
Zhao et al. [12] demonstrated the applicability of many deep learning methods to machine monitoring. The success of classical machine learning techniques depends on efficient feature extraction, which requires considerable resources and time. Recently developed techniques in deep learning have enabled automatic feature extraction without the need for an expert, thereby simplifying the final solution while obtaining high accuracy. Recent studies on one-dimensional (1D) signals, especially vibration signals, have used convolutional neural networks (CNNs) [16,17,18,19,20,21] for classification.
On the basis of the findings and limitations indicated by the aforementioned studies, the present study focused on developing a system for capturing vibration signals and a 1D CNN model for classifying such signals to achieve end-to-end monitoring of stamping tool wear. This study’s contributions are detailed as follows.
  • The study developed of a system for processing vibration signals by using a template matching algorithm in order to identify tool wear conditions.
  • The study applied a deep 1D CNN along with a fully connected neural network (FCNN) for feature extraction to classify tool wear conditions. The optimal configuration was determined through the comparison of 1D CNN and FCNN configurations.
  • The study applied real data from a mass production workpiece to evaluate the developed methods and algorithms.
  • The proposed method not only enables the reliable and real-time monitoring of stamping tools through processes involving data acquisition and data classification; the method also minimizes computational time throughout these processes. The experimental results demonstrated the applicability of our method to actual machines, with the method exhibiting high signal acquisition rates and excellent classification efficiency.
The remainder of the paper is organized as follows. In Section 2, the proposed methods and data acquisition process are presented. In Section 3, the signal acquisition rate and tool wear classification performance are described. Finally, Section 4 presents the conclusion of this study.

2. Materials and Methods

The flow of the proposed system’s operation is shown in Figure 1. Raw data obtained from sensors at specific time intervals are first preprocessed and then divided into two signal domains, the time-based domain, and frequency-based domain. After data processing, template matching is used to compare the processed data with the template data. If the required conditions are satisfied, the signal data are selected and then recognized.

2.1. Experimental Data

The experimental data used in this study were obtained from an actual working stamping process. Specifically, progressive stamping tools were placed into a reciprocating stamping machine, and an automatic sheet metal feeder fed the metal sheet to be stamped into the stamping tool, which pressed the metal sheet to the intended shape.
Stamping involves various processes, such as blanking, piercing, drawing, forming, and bending, that are executed using distinct tools. In this study, the piercing process, which tends to yield the most tool wear, was monitored at several positions where the tool comes in contact with the material. Figure 2 presents the wear monitoring points inside a progressive tool used for piercing. Figure 3 depicts the finished product, with the numbered boxes indicating the location at which the tool die was applied. The stamping tool, metal sheet workpiece and stamping machine used in this study are illustrated in Figure 4.
After manually inspecting six sets of vibration data from the two sensors, we decided to use the y-axis vibration data from the lower accelerometer because this accelerometer produced distinctive stamping vibration signals and the least data noise. We observed two stages of wear (mild and heavy) at each tool position (Table 1). Detailed conditions are shown in Appendix A. Table 2 presents the classification of the experimental data regarding the various tool conditions, indicating seven class types; only one class represented the healthy condition, three represented the heavy wear condition, and the remaining three represented the mild wear condition. This table also indicates the number of samples and average stamping time for each class.
In general, in stamping, each vibration signal cycle represents three actions (Figure 5): (1) contact of the stamping tool with the metal sheet, (2) shear force in the metal sheet that is engendered by the impaction of the tool against the metal sheet, and (3) separation of the tool from the metal sheet.
However, because a real environment was considered in this study, the conditions under which data were extracted could not be adjusted. Therefore, some classes did not include signals that exhibited a typical cycle with the three actions. Instead, shock vibration was produced only when the sheet was cut through shear force. Examples of vibration signals obtained from classes 4 and 5 are illustrated in Figure 6, indicating slight or nonexistent shock vibrations when the tool came into contact with the metal sheet and separated from the metal sheet. Accordingly, we randomly selected a signal with or without action 1 or 3 as the template signal.

2.2. Signal Acquisition

Tool condition data were obtained from an LCP-60H press machine (Ing Yu Machinery, Taichung, Taiwan) with a capacity of 60 tons and an automatic sheet metal feeder. The sheet material was 1.5 mm thick SPCC. Table 3 lists the experimental parameters for the stamping process. Two multiaxis PCB356A15 accelerometers with a sensitivity of 100 mV/g and measurement precision of ±50 g were mounted at the top and bottom sections of the tool (Figure 7) to measure vibrations at a sampling rate of 25,600 Hz; NI 9234 served as the data acquisition module. Throughout the stamping process, signal data were recorded for 10 s whenever a vibration shock was detected; all classes had more than 1 h of raw data on stamping vibrations (comprising more than 92 million data points).

2.3. Data Processing

The obtained vibration signals were then analyzed visually. Figure 8 presents a flowchart of the data preprocessing procedure. This procedure involved two stages: signal acquisition and 1D CNN model execution. For signal acquisition, the raw data were first transformed to a resolution of n values by using root mean square (RMS) values to expedite the template matching process. After the acquisition of a signal, the raw data were processed for the 1D CNN model. Such processing is necessary because it prevents extreme input values, which lead to poor results, and because a 1D CNN model cannot process data with inconsistent input lengths. The data set used in this study contained a collection of data objects (samples) whose lengths differed between classes. Because a CNN model requires input data with a fixed length, the data samples were transformed to ensure that they had the same length. Moreover, the power spectral density (PSD) was used as a measure of the signal’s power content versus frequency to account for the possible length variation of the data entered into the system. The frequency range was set to 50% of the sampling rate, which was maintained at 25.6 kHz. We did not split the signal because doing so may obscure meaningful features in the signal itself. In general, the PSD is used to transform time-domain signals of different lengths into frequency-domain signals of the same length. Moreover, it can be used to analyze the frequency of signals x ( t )   as the ordinary Fourier transform   x ^ ( ω )   with a finite interval of (0, T). The truncated Fourier transform can be obtained as follows:
x ^ ( ω ) = 1 T 0 T x ( t ) e i ω t d t
A uniform resolution was not obtained even after the data were transformed to have a fixed frequency range. This problem can be resolved using simple linear interpolation, which is mathematically expressed as follows:
y y 0 x x 0 = y 1 y 0 x 1 x 0
The PSD generally represents a very low power amplitude. If such values are entered into the CNN algorithm without normalization (i.e., conversion to a value between 1 and 0), the CNN activation function will not function as intended, thus preventing the model from learning effectively. The normalization equation is expressed in Equation (3):
N o r m a l i z e d   ( e i ) = e i E m i n E m a x E m i n

2.4. Template Matching

To simplify the comparative evaluation of several distance metrics, template matching was used. This technique is designed to be sufficiently simple to avoid confusion and accelerate the computation process.
This technique mainly involves calculating the distance between templates and the testing signal and determining the boundary-dependent similarity decisions (Figure 9). In this process, vibration data signals are continuously extracted using sliding windows, which are then converted to a length equal to the length of the template used. Finally, the value of each incoming data point is calculated.
Furthermore, several classes of signals can be extracted. These signals are calculated in terms of distance metrics; specifically, the local minima are calculated to determine the signal that is closest in value to the signal template. The local minima must be smaller than a predetermined threshold value. Signal templates are obtained from manual observations and random selection to avoid possible bias against one method or type of data.

2.5. Distance Metrics

This study used several distance metrics, namely, the root mean square error (RMSE), correlation coefficient, kurtosis, skewness, and mean, on the assumption that the shape of the target pattern remained constant. Consider signals A and B with signal lengths PA and PB, respectively. The equations for the distance metrics for these signals are as follows:
R M S E : d r s m e = 1 P · n = 1 P { A ( n ) B ( n ) } 2 .
C o r r e l a t i o n   C o e f f i c i e n t : d c o r r = n = 1 P { A ( n ) A ¯ } · { B ( n ) B ¯ } n = 1 P { A ( n ) A ¯ } 2 · n = 1 P { B ( n ) B ¯ } 2   .
K u r t o s i s : d k u r = | n = 1 P A { A ( n ) A ¯ } 4 P A · σ A 4 n = 1 P B { B ( n ) B ¯ } 4 P B · σ B 4 |   .
S k e w n e s s : d s k e w = 1 P n = 1 P { ( A n B n ) ( A B ) ¯ } 3 ( 1 P i = 1 P { ( A n B n ) ( A B ) ¯ } 2 ) 3
M e a n : d m e a n = i = 1 n ( A i B i ) n
A(n) and B(n) represent the nth data points of signals A and B, respectively, and P represent the length of the signals.

2.6. Autothreshold

The signal matching protocol (Figure 7) includes a step wherein a threshold is defined for the algorithm to search for the local minima. The algorithm comprises an autothreshold value from the template used, a standard deviation equation for the RSME metric Equation (9), and the variance for the mean distance metric Equation (10). The signals are captured after a comparison between the incoming signals and template signals; if an incoming signal has the same shape and magnitude as the template signal, the value of the distance metric decreases or increases, as discussed in Section 3.1.
S t a n d a r d   D e v i a t i o n : σ = ( x i μ ) 2 P
V a r i a n c e : V = 1 P 1 i = 1 P | x i μ | 2
x i = value from the template signal; μ = mean value of the template signal; P = template signal length.

2.7. Convolutional Neural Network

Deep CNNs are designed to be operate on 2D datasets of images and videos; however, 1D CNNs have clear advantages over 2D CNNs for capturing signals. Like 2D CNNs, 1D CNNs also serve as trainable filters that can learn to filter important features from 1D data. The output from 1D CNNs can then be used in an FCNN (Figure 10) to perform conventional classification operations. 1D CNNs differ from 2D CNNs in that they use a 1D array for feature maps and kernels; hence, the kernel size and parameters for subsampling are in the form of scalars. The FCNN uses the conventional backpropagation (BP) method.
1D forward propagation from convolution layer l − 1 to the input of a neuron in layer l is expressed as shown in Equation (11).
x k l = b k l + i = 1 N l 1 c o n v 1 D ( w k l 1 , s k l 1 )
where x k l represents the input, b k l is the bias of the kth neuron at layer l, and s k l 1 is the output of the ith neuron at layer l − 1. Moreover, w k l 1 represents the kernel (“mask” or “weight”) from the ith neuron at layer l − 1 to the kth neuron at layer l. Therefore, if y k l is defined as the output, it can be expressed by a function of x k l , as shown in Equation (12):
y k l = f ( x k l ) s k l = y k l s s
where s k l denotes an output of the kth neuron in the l layer and   s s denotes a downscaling factor for the output with a scale factor of s s . In an FCNN, BP is performed starting from the multilayer perceptron if it has NL classes. The mean square error (MSE) is expressed as follows:
E p = M S E ( t p , [ y 1 L , , y N L L ] ) = i = 0 N L ( y i L t i p ) 2
where L = 1 represents the input layer, l = L represents the identity between an input and output, p represents the input vector, t i p represents the corresponding target, and [ y 1 L , , y N L L ] represent the output vectors.
In this study, batch normalization (BN) was used after the application of the convolution filters. Suppose that the data contain m training examples; the mean can be calculated using Equation (14):
μ 1 m i = 1 m x i
Then, the variance of these training examples or the mini batch can be calculated as follows:
σ 2 1 m i = 1 m ( x i μ ) 2
After the variance is obtained, the formula for BN can be applied, as shown in Equation (16), where γ and β are trainable parameters.
y i γ x i μ σ 2 + ϵ + β = B N γ , β ( x i )
Moreover, LeakyReLU nonlinearity can be used, as expressed in Equation (17):
f ( x )   =   { x ,     i f   x > 0 a x ,   o t h e r w i s e
The reference model of 1D CNN used in this study is shown in Figure 11. It combines convolutional filters, batch normalization, following by performing LeakyReLU and MaxPooling to attain downsampling.

3. Results

The main results of this study pertained to two aspects, namely, signal acquisition and signal recognition. Results pertaining to signal acquisition revealed the system’s signal acquisition accuracy, and those pertaining to signal recognition revealed the 1D CNN model’s performance in classifying the stamping signals. Template matching were conducted using the 64-bit version of LabVIEW 2019, whereas 1D CNN modeling was conducted using Tensorflow in Python. These systems were run on a Windows computer with an AMD Ryzen 7 3750H processor, 24 GB of RAM, and NVIDIA GeForce RTX 2060.

3.1. Distance Metrics Performance

Five algorithms were compared with respect to two key indicators. The first indicator was the distinctive distance, which was evaluated in the absence of a signal, in the presence of a noise signal, and in the presence of a stamping signal.
Figure 12 presents the performance of each distance metric. All three algorithms could detect vibration signals to some degree, and the kurtosis, RMSE, skewness, and mean values indicated that the algorithms could distinguish between time points with a noise signal, without a signal, and with a stamping signal. However, the correlation coefficient tends to fluctuate with a small change in input value. This is because the calculation of the correlation coefficient ignores the magnitude and only focuses on the “shape” of each vector. Therefore, the correlation coefficient is unsuitable as a distance metric for signal matching after acquiring a vibratory signal because determining the optimal threshold value would be difficult. The second indicator was the computation time.
The vibration signal obtained in the stamping process could be as short as 0.1 s. Therefore, to capture such short signals, the computation time should be measured for each distance metric in order to determine the metric that yields the shortest computation time. Figure 13 presents the computation time of each distance metric. As expected, the RMSE and mean had the shortest computation time because only simple mathematical operations are used. Although the correlation coefficient, kurtosis, and skewness had short computation times, they required the data length to be scaled, which lengthened the computation time. Accordingly, the RMSE and mean was indicated the be most suitable (i.e., best performing) distance metric.

3.2. Autothresholding Performance

In this study, autothresholding performance was tested in terms of the RMSE and mean. These tests involved assessments of sensitivity or recall, miss rate, and precision or positive predicted value. In this experiment, template signals of random size were manually selected from random sections in each class; the selection process was repeated four times in each class. All the signals were obtained when the tool cut the metal sheet. Three measures were used: true positive (TP), false positive (FP), and false negative (FN). Figure 14b shows a TP classification; that is, the algorithm could fully capture a signal. Figure 14c presents an FP classification; that is, the algorithm failed to capture the whole signal, with one or more parts missing. Figure 14d shows an FN classification; that is, the algorithm could not capture the signal of interest. The TF signal is not presented in Figure 14 because it is only applicable in the condition when no stamping signal is present.
Figure 15 shows the autothresholding performance as assessed in terms of the standard deviation of the RMSE and the variance of the mean. The thresholds are indicated by the red dotted line, and the RMSE and mean values were obtained using sliding windows. This figure indicates that autothresholding could be used to determine whether local minima should be calculated. This reduces computation time while ensuring that the stamping signal is captured. Although the standard deviation of the RMSE and variance of the mean can be used as the autothreshold, we found some inconsistency when using the variance as the autothreshold (Figure 16) for some cases where the template signal was long; if the variance autothreshold is below its mean value, local minima cannot be detected.
Thus, we only used the RMSE as the distance metric and the standard deviation as the autothreshold.
We observed that classes with the same degree of wear also had the same type of signal in terms of shape and amplitude (Figure 17); heavy but not mild wear was associated with continuous vibration to some degree. We conducted an autothresholding experiment by using class 1 (the healthy condition), by randomly selecting one of classes 2 to 4 (heavy wear conditions), and by randomly selecting one of classes 5 to 7 (mild wear conditions). Table 4 shows the results for data from the same class, and cross-class. Detailed results are shown in Appendix B. The results revealed a high sensitivity (0.950) and precision (0.876). Cross-class examination is required because, in real-time monitoring, the incoming signals can be from any class. Table 4b presents the results of cross-class examination, meaning that a template from another class is used to capture signals from other classes. The sensitivity and precision exceeded 0.8 in some cases but were very low for other cases. An investigation was conducted for cases with poor precision, and these cases were found to involve very narrow template signals, which resulted in very narrow windows for the acquisition of the correct signal, resulting in poor sensitivity and precision.

3.3. Tool Condition Classification Using a 1D CNN and Model Optimization

The proposed CNN was tested using data obtained according to the description in Section 2.1. These input data were then preprocessed to have the same data length by using the method described in Section 2.3 (Figure 18).
Figure 19 presents the classification results produced by the model (referenced in Section 2.7) when testing data were used. For every class, the predicted values matched the actual values. We could analyze misclassifications using a confusion matrix; this matrix was also used to evaluate classification accuracy. An accuracy rate of 100% was obtained, but many previous studies have reported that adaptive 1D CNNs can perform better than other classification algorithms, such as support vector machine (SVM), k-nearest neighbors, SVM ensemble, and artificial neural network architectures. In this study, hyperparameter optimization was used because the model must be as simple as possible to reduce the computation time while maintaining a high accuracy for classifying each class correctly. The total numbers of parameters obtained by the reference model described in Section 2.7 are shown in Figure 20. The parameters comprised weights and biases that were either trainable or not trainable in the 1D CNN model.
The number of nodes in the FCNN and CNN filters was reduced to decrease the number of parameters, but other hyperparameters, such as the alpha value for LeakyReLU and the dropout, were not altered because they did not significantly reduce the size of the model. Of the data available, 30% and 70% were validation and training data, respectively. The results obtained after the training process indicated significant differences between models with respect to the total number of parameters (Table 5). Although the number of parameters decreased sequentially from the reference model to the smallest model, the accuracy did not decrease significantly. Furthermore, the second smallest model with 200,000 parameters exhibited a high level of accuracy; although, it had only 1/137 of the parameters in the reference model; however, when that model had only 100,000 parameters, the accuracy decreased, and we thus did not decrease the number of parameters further.

3.4. Data Reduction for Model Training

The case in this study only used one type of progressive stamping tool; however, in actual case scenarios, the proposed model architecture could be used for other types of stamping tools. Figure 21 illustrates a graph that can serve as a reference for determining the quantity of data required to retrain the model. The graph depicts the behavior of the two smallest models when they were trained using different quantities of data. The data shown in the figure include data that were used for training and validation; the remaining data were used for testing. Because the accuracy of each model was tested using the test data, these data had not been used during model training. As stated in Section 3.3, the model with 200,000 parameters yielded the lowest accuracy, which can be confirmed by the results shown in Figure 21.
The majority of one cycle monitoring were composed by signal acquisition, data preprocessing, and prediction using 1D CNN. In the present study, the actual computation times of one cycle monitoring period of the 1960 samples were 0.14–0.18 s, and it depended on the data length of template signal. For example, in this study case, the stamping speed was 40 rpm which equals to 1.5 s of one cycle stamping process time. The computation times of one cycle monitoring period was 0.18 s; therefore, there was enough time to real-time monitoring and classify the condition of tool wear during every cycle stamping process. The proposed method could be applied for stamping speed up to 100 rpm and satisfy the industrial specifications of most metal stamping.

4. Conclusions

In this study, a method of capturing vibratory signals during the stamping process was proposed and verified using real-case data. Several distance metrics were compared, and the results revealed that the RMSE was the most suitable distance metric due to its effectiveness and speed. An autothresholding method was also employed to help determine the local minimum threshold from different template signals. The proposed method was validated based on sensitivity and precision. A sensitivity of >0.9 (indicating favorable performance) was obtained from experimental results for the same-class and cross-class configurations, and a precision of >0.85 was obtained for both configurations. The results of this study can serve as a reference for the extraction of signals with periodic characteristics and shape similarity.
The use of an adaptive 1D CNN for classifying stamping-induced vibration signals was extensively studied. Localized raw data of vibration signals were normalized using the PSD and then entered into the 1D CNN Model. The 1D CNN presents the advantages of adaptability and rapid feature learning. Moreover, the effectiveness of the 1D CNN was assessed using a real-case scenario. The size of the model in this study was reduced greatly owing to the rapid adaptability of the 1D CNN, and an accuracy of up to 99.8% was achieved. The amounts of training and validation data were also investigated. An accuracy of >90% could be achieved with only 90 data points from each class. These findings show that the 1D CNN can be used in real time for classifying vibration signals during stamping. Although the effectiveness of the proposed 1D CNN was verified, problems remain to be addressed for its application in mass production. The proposed 1D CNN is not flexible in terms of the number of classes. Future studies should aim to overcome this problem by using Siamese neural networks.
This study’s findings can serve as a reference for manufacturers in developing strategies for reducing the cost of tool maintenance and improving product quality.

Author Contributions

Conceptualization, C.-Y.H.; Data curation, C.-Y.H. and Z.D.; Formal analysis, Z.D.; Investigation, C.-Y.H. and Z.D.; Methodology, C.-Y.H. and Z.D.; Resources, C.-Y.H.; Software, Z.D.; Supervision, C.-Y.H.; Validation, C.-Y.H.; Writing—original draft, C.-Y.H. and Z.D.; Writing—review & editing, C.-Y.H. and Z.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not Applicable.

Informed Consent Statement

Not Applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to further study will be carried out using the same data.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Figure A1. (a) Healthy condition, (b) mild wear, and (c) heavy wear at position A.
Figure A1. (a) Healthy condition, (b) mild wear, and (c) heavy wear at position A.
Sensors 21 00262 g0a1
Figure A2. (a) Healthy condition, (b) mild wear, and (c) heavy wear at position B.
Figure A2. (a) Healthy condition, (b) mild wear, and (c) heavy wear at position B.
Sensors 21 00262 g0a2
Figure A3. (a) Healthy condition, (b) mild wear, and (c) heavy wear at position C.
Figure A3. (a) Healthy condition, (b) mild wear, and (c) heavy wear at position C.
Sensors 21 00262 g0a3

Appendix B

Table A1. (a) True positive signal, (b) false negative signal, (c) false positive signal.
Table A1. (a) True positive signal, (b) false negative signal, (c) false positive signal.
(a)
Sensitivity Rate
ClassTrial
1234
11111
31111
70.71410.8330.857
(b)
Precision
ClassTrial
1234
110.8570.8570.857
30.8570.8570.8570.71
70.83310.8331
(c)
Miss Rate
ClassTrial
1234
10000
30000
70.28500.1660.142
Table A2. (d) sensitivity, (e) precision, (f) and miss rate for cross-class capture. “1→4” means that signals were obtained from class 1 and templates were from class 4.
Table A2. (d) sensitivity, (e) precision, (f) and miss rate for cross-class capture. “1→4” means that signals were obtained from class 1 and templates were from class 4.
(d)
Sensitivity Rate
ClassTrial
1234
1→41111
3→10.857110.833
7→20.8330.8570.8330.667
(e)
Precision
ClassTrial
1234
1→40.85710.8570.857
3→110.42810.833
7→20.83310.8330.8
(f)
Miss Rate
ClassTrial
1234
1→40000
3→10.142000.167
7→20.1670.1420.1670.333

References

  1. Cao, J.; Brinksmeier, E.; Fu, M.; Gao, R.X.; Liang, B.; Merklein, M.; Schmidt, M.; Yanagimoto, J. Manufacturing of advanced smart tooling for metal forming. CIRP Ann. 2019. [Google Scholar] [CrossRef]
  2. Wu, T.L.; Sari, D.Y.; Lin, B.T.; Chang, C.W. Monitoring of punch failure in micro-piercing process based on vibratory signal and logistic regression. Int. J. Adv. Manuf. Technol. 2017, 93, 2447–2458. [Google Scholar] [CrossRef]
  3. Sari, D.Y.; Wu, T.L.; Lin, B.T. Study of sound signal for online monitoring in the micro-piercing process. Int. J. Adv. Manuf. Technol. 2018, 97, 697–710. [Google Scholar] [CrossRef]
  4. Shanbhag, V.V.; Rolfe, B.F.; Pereira, M.P. Investigation of galling wear using acoustic emission frequency characteristics. Lubricants 2020, 8, 25. [Google Scholar] [CrossRef] [Green Version]
  5. Ge, M.; Du, R.; Xu, Y. Hidden Markov model based fault diagnosis for stamping processes. Mech. Syst. Signal Process. 2004. [Google Scholar] [CrossRef]
  6. Tian, H.; Wang, D.; Lin, J.; Chen, Q.; Liu, Z. Surface defects detection of stamping and grinding flat parts based on machine vision. Sensors 2020, 20, 4531. [Google Scholar] [CrossRef] [PubMed]
  7. Ge, M.; Zhang, G.C.; Du, R.; Xu, Y. Feature extraction from energy distribution of stamping processes using wavelet transform. JVC J. Vib. Control 2002. [Google Scholar] [CrossRef]
  8. Zhang, G.; Li, C.; Zhou, H.; Wagner, T. Punching process monitoring using wavelet transform based feature extraction and semi-supervised clustering. Procedia Manuf. 2018, 26, 1204–1212. [Google Scholar] [CrossRef]
  9. Sari, D.Y.; Wu, T.L.; Lin, B.T. Preliminary study for online monitoring during the punching process. Int. J. Adv. Manuf. Technol. 2017, 88, 2275–2285. [Google Scholar] [CrossRef]
  10. Jinikol, M. Punching Tool Wear Modeling Using Finite Element Method. Bachelor’s Thesis, University Malaysia Pahang, Pahang, Malaysia, November 2009. [Google Scholar]
  11. Zhang, G.C.; Ge, M.; Tong, H.; Xu, Y.; Du, R. Bispectral analysis for on-line monitoring of stamping operation. Eng. Appl. Artif. Intell. 2002. [Google Scholar] [CrossRef]
  12. Zhao, R.; Yan, R.; Chen, Z.; Mao, K.; Wang, P.; Gao, R.X. Deep learning and its applications to machine health monitoring. Mech. Syst. Signal Process. 2019, 115, 213–237. [Google Scholar] [CrossRef]
  13. Abdoli, S.; Cardinal, P.; Lameiras Koerich, A. End-to-end environmental sound classification using a 1D convolutional neural network. Expert Syst. Appl. 2019. [Google Scholar] [CrossRef] [Green Version]
  14. Eren, L. Bearing fault detection by one-dimensional convolutional neural networks. Math. Probl. Eng. 2017, 2017. [Google Scholar] [CrossRef] [Green Version]
  15. Liu, J.; Gibson, S.J.; Mills, J.; Osadchy, M. Dynamic spectrum matching with one-shot learning. Chemom. Intell. Lab. Syst. 2019. [Google Scholar] [CrossRef]
  16. Pandhare, V.; Singh, J.; Lee, J. Convolutional Neural Network Based Rolling-Element Bearing Fault Diagnosis for Naturally Occurring and Progressing Defects Using Time-Frequency Domain Features. In Proceedings of the 2019 Prognostics and System Health Management Conference, PHM-Paris, Paris, France, 2–5 May 2019. [Google Scholar]
  17. Zhang, J.; Sun, Y.; Guo, L.; Gao, H.; Hong, X.; Song, H. A new bearing fault diagnosis method based on modified convolutional neural networks. Chin. J. Aeronaut. 2020, 33, 439–447. [Google Scholar] [CrossRef]
  18. Frank, J.; Mannor, S.; Pineau, J.; Precup, D. Time series analysis using geometric template matching. IEEE Trans. Pattern Anal. Mach. Intell. 2013. [Google Scholar] [CrossRef] [PubMed]
  19. Omachi, S.; Omachi, M. Fast template matching with polynomials. IEEE Trans. Image Process. 2007. [Google Scholar] [CrossRef] [PubMed]
  20. Chen, J.H.; Chen, C.S.; Chen, Y.S. Fast algorithm for robust template matching with M-estimators. IEEE Trans. Signal Process. 2003. [Google Scholar] [CrossRef]
  21. Chang, W.D.; Im, C.H. Enhanced template matching using dynamic positional warping for identification of specific patterns in electroencephalogram. J. Appl. Math. 2014, 2014. [Google Scholar] [CrossRef]
Figure 1. Overall system operation.
Figure 1. Overall system operation.
Sensors 21 00262 g001
Figure 2. Tool monitoring positions.
Figure 2. Tool monitoring positions.
Sensors 21 00262 g002
Figure 3. Images of the finished product from the (a) top and (b) right side; the piercing processes A, B, and C are marked by the numbers 1, 2, and 3, respectively.
Figure 3. Images of the finished product from the (a) top and (b) right side; the piercing processes A, B, and C are marked by the numbers 1, 2, and 3, respectively.
Sensors 21 00262 g003
Figure 4. (a) tools used and the (b) press machine.
Figure 4. (a) tools used and the (b) press machine.
Sensors 21 00262 g004
Figure 5. One signal cycle in the stamping process.
Figure 5. One signal cycle in the stamping process.
Sensors 21 00262 g005
Figure 6. Vibration signals obtained from (a) class 4 and (b) class 5 in the experimental stamping process.
Figure 6. Vibration signals obtained from (a) class 4 and (b) class 5 in the experimental stamping process.
Sensors 21 00262 g006
Figure 7. Positions of the accelerometer sensors.
Figure 7. Positions of the accelerometer sensors.
Sensors 21 00262 g007
Figure 8. Data processing flowchart.
Figure 8. Data processing flowchart.
Sensors 21 00262 g008
Figure 9. Schematic of the signal matching protocol.
Figure 9. Schematic of the signal matching protocol.
Sensors 21 00262 g009
Figure 10. 1D convolutional neural network (CNN) with a fully connected layer [12].
Figure 10. 1D convolutional neural network (CNN) with a fully connected layer [12].
Sensors 21 00262 g010
Figure 11. Diagram of a convolutional network with attached fully connected neural network (FCNN).
Figure 11. Diagram of a convolutional network with attached fully connected neural network (FCNN).
Sensors 21 00262 g011
Figure 12. (a) Root mean square (RMS) of signals from the vibration in the stamping process. Sliding windows were applied from the template signal across the RMS signal, resulting in (b) the correlation coefficient, (c) kurtosis, (d) RMSE, (e) skewness, and (f) mean metrics.
Figure 12. (a) Root mean square (RMS) of signals from the vibration in the stamping process. Sliding windows were applied from the template signal across the RMS signal, resulting in (b) the correlation coefficient, (c) kurtosis, (d) RMSE, (e) skewness, and (f) mean metrics.
Sensors 21 00262 g012
Figure 13. Distance metrics: computation time.
Figure 13. Distance metrics: computation time.
Sensors 21 00262 g013
Figure 14. (a) Results of signal acquisition using autothresholding. Red dotted lines indicate the best matched signal. (b) True positive signal, (c) false positive signal, and (d) and false negative signal.
Figure 14. (a) Results of signal acquisition using autothresholding. Red dotted lines indicate the best matched signal. (b) True positive signal, (c) false positive signal, and (d) and false negative signal.
Sensors 21 00262 g014
Figure 15. Autothresholding performance as assessed in terms of (a) standard deviation and (b) variance of the template signal (red dotted line).
Figure 15. Autothresholding performance as assessed in terms of (a) standard deviation and (b) variance of the template signal (red dotted line).
Sensors 21 00262 g015
Figure 16. Autothresholding using (a) standard deviation and (b) variance in same template signal.
Figure 16. Autothresholding using (a) standard deviation and (b) variance in same template signal.
Sensors 21 00262 g016
Figure 17. Vibratory signal from (a)–(f) represent class 2 to 7, respectively.
Figure 17. Vibratory signal from (a)–(f) represent class 2 to 7, respectively.
Sensors 21 00262 g017aSensors 21 00262 g017b
Figure 18. Normalized transformation of Fast Fourier Transform from time-based to frequency-based.
Figure 18. Normalized transformation of Fast Fourier Transform from time-based to frequency-based.
Sensors 21 00262 g018
Figure 19. Confusion matrix of the classification results.
Figure 19. Confusion matrix of the classification results.
Sensors 21 00262 g019
Figure 20. Total numbers of parameters from the reference model.
Figure 20. Total numbers of parameters from the reference model.
Sensors 21 00262 g020
Figure 21. Comparison of accuracies for different amounts of training data.
Figure 21. Comparison of accuracies for different amounts of training data.
Sensors 21 00262 g021
Table 1. Tool wear figure and name tagging.
Table 1. Tool wear figure and name tagging.
Identification NumberProcess LocationMild WearHeavy Wear
1.Piercing Position ASensors 21 00262 i001Sensors 21 00262 i002
2.Piercing Position BSensors 21 00262 i003Sensors 21 00262 i004
3.Piercing Position CSensors 21 00262 i005Sensors 21 00262 i006
Table 2. Data obtained from the experiment.
Table 2. Data obtained from the experiment.
Class NameClass TypeNumber of SamplesAverage Stamping Time (s)
Healthy ConditionClass 12800.26
Heavy Wear Position AClass 22800.183
Heavy Wear Position BClass 32800.27
Heavy Wear Position CClass 42800.393
Mild Wear Position AClass 52800.113
Mild Wear Position BClass 62800.13
Mild Wear Position CClass 72800.12
Table 3. Experimental parameters for the stamping process.
Table 3. Experimental parameters for the stamping process.
LubricationAnti-Corrosive Oil
Sheet materialSPCC
Sheet thickness (mm)1.5
Stamping speed (rpm)40
Die materialSKD 11
Average Blanking force29.5 kN
Number of parts formed1960
Table 4. Average sensitivity, precision, and miss rates for data acquisition (a) within the same class and (b) cross various classes.
Table 4. Average sensitivity, precision, and miss rates for data acquisition (a) within the same class and (b) cross various classes.
(a)(b)
ClassSensitivity RatePrecisionMiss RateClassSensitivity RatePrecisionMiss Rate
110.89201→410.8920
310.82103→10.9220.8150.077
70.8510.9170.1487→20.7970.8660.202
Average0.950.8760.049Average0.90670.85830.093
Table 5. Model size and accuracy.
Table 5. Model size and accuracy.
Total ParametersAccuracy (%)
14,025,991100
13,040,31199.8
13,026,13599.8
3,260,94399.8
3,257,00799.8
1,631,59999.8
817,23199.8
204,49599.7
204,38799.8
102,29198.0
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Huang, C.-Y.; Dzulfikri, Z. Stamping Monitoring by Using an Adaptive 1D Convolutional Neural Network. Sensors 2021, 21, 262. https://doi.org/10.3390/s21010262

AMA Style

Huang C-Y, Dzulfikri Z. Stamping Monitoring by Using an Adaptive 1D Convolutional Neural Network. Sensors. 2021; 21(1):262. https://doi.org/10.3390/s21010262

Chicago/Turabian Style

Huang, Chih-Yung, and Zaky Dzulfikri. 2021. "Stamping Monitoring by Using an Adaptive 1D Convolutional Neural Network" Sensors 21, no. 1: 262. https://doi.org/10.3390/s21010262

APA Style

Huang, C. -Y., & Dzulfikri, Z. (2021). Stamping Monitoring by Using an Adaptive 1D Convolutional Neural Network. Sensors, 21(1), 262. https://doi.org/10.3390/s21010262

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop