Design and Implementation of Machine Tool Life Inspection System Based on Sound Sensing
Abstract
:1. Introduction
2. Life Cycle Estimation Methodology
3. Noise Reduction Methodology
4. Experimental Results and Discussion
5. Conclusions
Author Contributions
Funding
Conflicts of Interest
References
- Tsai, Y.T. Applying a Case-Based Reasoning Method for Fault Diagnosis During Maintenance. Proc. Inst. Mech. Eng. Part C 2009, 223, 2431–2441. [Google Scholar] [CrossRef]
- Eser, A.; Askar Ayyildiz, E.; Ayyildiz, M.; Kara, F. Artificial Intelligence-Based Surface Roughness Estimation Modelling for Milling of AA6061 Alloy. Adv. Mater. Sci. Eng. 2021, 2021, 5576600. [Google Scholar] [CrossRef]
- Kara, F.; Karabatak, M.; Ayyildiz, M.; Nas, E. Effect of machinability, microstructure and hardness of deep cryogenic treatment in hard turning of AISI D2 steel with ceramic cutting. J. Mater. Res. Technol. 2020, 9, 969–983. [Google Scholar] [CrossRef]
- Li, X.; Zhang, W.; Ding, Q. Deep learning-based remaining useful life estimation of bearings using multiscale feature extraction. Reliab. Eng. Syst. 2019, 182, 208–218. [Google Scholar] [CrossRef]
- Chen, P.-J.; Wu, T.-L.; Lin, T.-J.; Lai, Y.-H.; Wu, T.-L.; Yeh, C. Life Period Estimation of Stamping Process Using Punch Sounds and Deep Neural Network. In Proceedings of the 2019 IEEE 7th International Conference on Industrial Engineering and App-lications (ICIEA), Xi’an, China, 19–21 June 2019; pp. 625–628. [Google Scholar]
- Furnon, N.; Serizel, R.; Essid, S.; Illina, I. DNN-Based Mask Estimation for Distributed Speech Enhancement in Spatially Unco-nstrained Microphone Arrays. IEEE/ACM Trans. Audio Speech Lang. Process. 2021, 29, 2310–2323. [Google Scholar] [CrossRef]
- Martin-Doñas, J.M.; Jensen, J.; Tan, Z.-H.; Gomez, A.M.; Peinado, A.M. Online Multichannel Speech Enhancement Based on Re-cursive EM and DNN-Bas-ed Speech Presence Estimation. IEEE/ACM Trans. Audio Speech Lang. Process. 2020, 28, 3080–3093. [Google Scholar] [CrossRef]
- Lee, M.-C.; Yeh, S.-C.; Chang, J.-W.; Chen, Z.-Y. Research on Chinese Speech Emotion Recognition Based on Deep Neural Network and Acoustic Features. Sensors 2022, 22, 4744. [Google Scholar] [CrossRef]
- Boli, W.; Poyi, C.; Junzhe, C.; BoJun, X.; Chu, Y.-S.; Hou, T.-C. Noise Reduction System Applied to Machine Tools. In Proceedings of the 2021 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW), Penghu, Taiwan, 15–17 September 2021; pp. 1–2. [Google Scholar]
- Saleem, N.; Khattak, M.I.; Al-Hasan, M.; Qazi, A.B. On Learning Spectral Masking for Single Channel Speech Enhancement Using Feedforward and Recurrent Neural Networks. IEEE Access. 2020, 8, 160581–160595. [Google Scholar] [CrossRef]
- Wang, Y.; Narayanan, A.; Wang, D. On Training Targets for Supervised Speech Separation. IEEE/ACM Trans. Audio Speech Lang. Process. 2014, 22, 1849–1858. [Google Scholar] [CrossRef] [Green Version]
- Xia, S.; Li, H.; Zhang, X. Using optimal ratio mask as training target for supervised speech separation. In Proceedings of the Asia-Pacific Signal and Information Processing Association 9th Annual Summit and Conference, Kuala Lumpur, Malaysia, 12–15 December 2017. pp. 163–166.
- Lee, J.; Choi, H.; Park, D.; Chung, Y.; Kim, H.-Y.; Yoon, S. Fault Detection and Diagnosis of Railway Point Machines by Sound Analysis. Sensors 2016, 16, 549. [Google Scholar] [CrossRef]
- Das, A.; Guha, S.; Singh, P.K.; Ahmadian, A.; Senu, N.; Sarkar, R. A Hybrid Meta-Heuristic Feature Se-lection Method for Identification of Indian Spoken Languages From Audio Signals. IEEE Access. 2020, 8, 181432–181449. [Google Scholar] [CrossRef]
- Cabral, F.S.; Fukai, H.; Tamura, S. Feature Extraction Methods Proposed for Speech Recognition Are Effective on Road Condition Monitoring Using Smartphone Inertial Sensors. Sensors 2019, 19, 3481. [Google Scholar] [CrossRef] [Green Version]
- Al-Ali, A.K.H.; Dean, D.; Senadji, B.; Chandran, V.; Naik, G.R. Enhanced Forensic Speaker Verification Using a Combination of DWT and MFCC Feature Warping in the Presence of Noise and Reverberation Conditions. IEEE Access. 2017, 5, 15400–15413. [Google Scholar] [CrossRef] [Green Version]
- Kim, C.; Stern, R.M. Power-Normalized Cepstral Coefficients (PNCC) for Robust Speech Recognition. IEEE/ACM Trans. Audio Speech Lang. Process. 2016, 24, 1315–1329. [Google Scholar] [CrossRef] [Green Version]
- Tamazin, M.; Gouda, A.; Khedr, M. Enhanced Automatic Speech Recognition System Based on Enhancing Power-Normalized Cepstral Coefficients. Appl. Sci. 2019, 9, 2166. [Google Scholar] [CrossRef] [Green Version]
- Nassif, A.B.; Shahin, I.; Attili, I.; Azzeh, M.; Shaalan, K. Speech Recognition Using Deep Neural Networks: A Systematic Review. IEEE Access. 2019, 7, 19143–19165. [Google Scholar] [CrossRef]
- Erkan, Ö.; Işık, B.; Çiçek, A.; Kara, F. Prediction of Damage Factor in end Milling of Glass Fibre Reinforced Plastic Composites Using Artificial Neural Network. Appl. Compos. Mater. 2012, 20, 517–536. [Google Scholar] [CrossRef]
- Serizel, R.; Moonen, M.; Wouters, J.; Jensen, S.H. Integrated Active Noise Control and Noise Reduction in Hearing Aids. IEEE/ACM Trans. Audio Speech Lang. Process. 2010, 18, 1137–1146. [Google Scholar] [CrossRef]
- Schasse, A.; Martin, R. Estimation of Subband Speech Correlations for Noise Reduction via MVDR Processing. IEEE/ACM Trans. Audio Speech Lang. Process. 2014, 22, 1355–1365. [Google Scholar] [CrossRef]
- Souden, M.; Araki, S.; Kinoshita, K.; Nakatani, T.; Sawada, H. A Multichannel MMSE-Based Framework for Speech Source Separation and Noise Reduction. IEEE/ACM Trans. Audio Speech Lang. Process. 2013, 21, 1913–1928. [Google Scholar] [CrossRef]
- Lee, G.W.; Kim, H.K. Multi-Task Learning U-Net for Single-Channel Speech Enhancement and Mask-Based Voice Activity Detection. Appl. Sci. 2020, 10, 3230. [Google Scholar] [CrossRef]
- Bao, F.; Abdulla, W.H. A Novel Training Target of DNN Used for Casa-Based Speech Enhancement. In Proceedings of the 2018 16th International Workshop on Acoustic Signal Enhancement (IWAENC), Tokyo, Japan, 17–20 September 2018. pp. 346–350.
- Wang, D.; Chen, J. Supervised Speech Separation Based on Deep Learning: An Overview. IEEE/ACM Trans. Audio Speech Lang. Process. 2018, 26, 1702–1726. [Google Scholar] [CrossRef] [PubMed]
- Jiang, W.; Wen, F.; Liu, P. Robust Beamforming for Speech Recognition Using DNN-Based Time-Frequency Masks Estimation. IEEE Access. 2018, 6, 52385–52392. [Google Scholar] [CrossRef]
Information | Description |
---|---|
Cutting method | Milling |
Processing material | aluminum block |
Cutting tool | 4 mm milling cutter for aluminum |
Processing conditions | Dry |
Feed rate | 500 mm/min |
Cutting depth | 0.1 mm |
Motor revolution | 20,000 times/min |
Cutting shape | Circle |
Tool moving speed | 30 mm/s |
Features MFCC | Original File |
---|---|
m1 | 0.5061 |
m2 | 0.3674 |
m3 | 0.5065 |
m4 | −0.6690 |
m5 | 0.6595 |
m6 | −0.7395 |
m7 | 0.8560 |
m8 | 0.6102 |
m9 | 0.7605 |
m10 | −0.1400 |
m11 | −0.7142 |
m12 | −0.5461 |
m13 | 0.3731 |
m14 | 0.7723 |
Before Noise Reduction | |
---|---|
Number of Features | Accuracy |
1 | 52% |
2 | 56% |
3 | 58% |
4 | 66% |
5 | 72% |
6 | 76% |
7 | 75% |
8 | 72% |
9 | 68% |
10 | 68% |
11 | 58% |
12 | 55% |
13 | 55% |
14 | 57% |
Test Data Percentage | Accuracy |
---|---|
Test data (90%) | 75% |
Training materials (10%) | |
Test data (80%) | 76% |
Training materials (20%) | |
Test data (70%) | 73% |
Training materials (30%) |
PESQ | MFCC | |
MASK | IRM | ORM |
Noise decibel | 10 dB | 10 dB |
before | 3.76 | 3.76 |
after | 3.82 | 3.84 |
promote | 0.06 | 0.08 |
lift rate | 1.6% | 2.1% |
PESQ | PNCC | |
MASK | IRM | ORM |
Noise decibel | 10 dB | 10 dB |
before | 3.76 | 3.76 |
after | 3.87 | 3.91 |
promote | 0.11 | 0.15 |
lift rate | 2.9% | 3.9% |
PESQ | GFCC | |
MASK | IRM | ORM |
Noise decibel | 10 dB | 10 dB |
before | 3.76 | 3.76 |
after | 3.87 | 3.86 |
promote | 0.11 | 0.1 |
lift rate | 2.9% | 2.6% |
STOI | MFCC | |
MASK | IRM | ORM |
Noise decibel | 10 dB | 10 dB |
before | 0.7963 | 0.7963 |
after | 0.8351 | 0.8496 |
promote | 0.0388 | 0.0536 |
lift rate | 4.8% | 2.1% |
STOI | PNCC | |
MASK | IRM | ORM |
Noise decibel | 10 dB | 10 dB |
before | 0.7963 | 0.7963 |
after | 0.8362 | 0.8506 |
promote | 0.0399 | 0.0543 |
lift rate | 5% | 6.8% |
STOI | GFCC | |
MASK | IRM | ORM |
Noise decibel | 10 dB | 10 dB |
before | 0.7963 | 0.7963 |
after | 0.8362 | 0.8492 |
promote | 0.0399 | 0.0529 |
lift rate | 5% | 6.6% |
STOI | 3 Layers | ||
---|---|---|---|
Aisle | 32 | 64 | 128 |
Promote | 0.0187 | 0.0193 | 0.0193 |
PESQ | 3 layers | ||
Aisle | 32 | 64 | 128 |
Promote | 0.07 | 0.12 | 0.11 |
STOI | 4 layers | ||
Aisle | 32 | 64 | 128 |
Promote | 0.0533 | 0.0543 | 0.0543 |
PESQ | 4 layers | ||
Aisle | 32 | 64 | 128 |
Promote | 0.09 | 0.15 | 0.12 |
STOI | 5 layers | ||
Aisle | 32 | 64 | 128 |
Promote | 0.0549 | 0.0519 | 0.234 |
PESQ | 5 layers | ||
Aisle | 32 | 64 | 128 |
Promote | 0.07 | 0.09 | 0.09 |
STOI | PNCC_DNN_ORM | |
Ratio | Training (80%) Testing (20%) | Training (70%) Testing (30%) |
SNR (dB) | 10 | 10 |
Before | 0.7963 | 0.7963 |
After | 0.8327 | 0.8506 |
Promote | 0.0364 | 0.0543 |
Lift rate | 4.5% | 6.8% |
PESQ | PNCC_DNN_ORM | |
Ratio | Training (80%) Testing (20%) | Training (70%) Testing (30%) |
SNR (dB) | 10 | 10 |
Before | 3.76 | 3.76 |
After | 3.89 | 3.91 |
Promote | 0.13 | 0.15 |
Lift rate | 3.4% | 4% |
STOI | PNCC_DNN_ORM | ||
Noise source | Cooling fan | ||
SNR (dB) | −4 | 0 | 4 |
Before | 0.1948 | 0.3271 | 0.4873 |
After | 0.5094 | 0.5895 | 0.6810 |
Promote | 0.3146 | 0.2642 | 0.1937 |
Lift rate | 162% | 80% | 40% |
PESQ | PNCC_DNN_ORM | ||
Noise source | Cooling fan | ||
SNR (dB) | −4 | 0 | 4 |
Before | 1.312 | 1.495 | 1.189 |
After | 2.233 | 2.233 | 2.861 |
Promote | 0.920 | 0.73 | 1.042 |
Lift rate | 70% | 49% | 57% |
Machine Tool Cutting Sound (Noise Decibel −4 dB)_PNCC | ||||
---|---|---|---|---|
Noise Source | Cooler | Factory Noise | ||
Mask | IRM | ORM | IRM | ORM |
Before | 1.512 | 1.512 | 1.233 | 1.233 |
After | 2.499 | 2.805 | 2.466 | 2.820 |
Promote | 0.987 | 1.293 | 1.233 | 1.587 |
Lift rate | 65% | 86% | 100% | 129% |
Noise source | Human voice | White noise | ||
Mask | IRM | ORM | IRM | ORM |
Before | 1.145 | 1.145 | 1.421 | 1.421 |
After | 2.558 | 2.835 | 2.456 | 2.807 |
Promote | 1.413 | 1.690 | 1.035 | 1.386 |
Lift rate | 123% | 148% | 73% | 98% |
Features MFCC | Original File | After Noise Reduction | Lift Rate |
---|---|---|---|
m1 | 0.5061 | 0.5633 | 11% |
m2 | 0.3674 | 0.8316 | 126% |
m3 | 0.5065 | 0.3541 | −15% |
m4 | −0.6690 | −0.7334 | 9% |
m5 | 0.6595 | 0.6913 | 5% |
m6 | −0.7395 | −0.7592 | 3% |
m7 | 0.8560 | 0.8613 | 0.5% |
m8 | 0.6102 | 0.6888 | 12% |
m9 | 0.7605 | 0.7721 | 1.5% |
m10 | −0.1400 | −0.1717 | 3% |
m11 | −0.7142 | −0.2020 | −71% |
m12 | −0.5461 | −0.1635 | −70% |
m13 | 0.3731 | 0.3650 | −2% |
m14 | 0.7723 | 0.4494 | −41% |
Before Noise Reduction | After Noise Reduction | Lift Rate | ||
---|---|---|---|---|
Number of Features | Accuracy | Number of Features | Accuracy | |
1 | 52% | 1 | 61% | 17% |
2 | 56% | 2 | 61% | 9% |
3 | 58% | 3 | 64% | 10% |
4 | 66% | 4 | 68% | 3% |
5 | 72% | 5 | 77% | 7% |
6 | 76% | 6 | 80% | 5% |
7 | 75% | 7 | 79% | 5% |
8 | 72% | 8 | 77% | 7% |
9 | 68% | 9 | 77% | 13% |
10 | 68% | 10 | 72% | 6% |
11 | 58% | 11 | 68% | 17% |
12 | 55% | 12 | 68% | 24% |
13 | 55% | 13 | 64% | 16% |
14 | 57% | 14 | 66% | 16% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Liu, T.-H.; Chi, J.-Z.; Wu, B.-L.; Chen, Y.-S.; Huang, C.-H.; Chu, Y.-S. Design and Implementation of Machine Tool Life Inspection System Based on Sound Sensing. Sensors 2023, 23, 284. https://doi.org/10.3390/s23010284
Liu T-H, Chi J-Z, Wu B-L, Chen Y-S, Huang C-H, Chu Y-S. Design and Implementation of Machine Tool Life Inspection System Based on Sound Sensing. Sensors. 2023; 23(1):284. https://doi.org/10.3390/s23010284
Chicago/Turabian StyleLiu, Tsung-Hsien, Jun-Zhe Chi, Bo-Lin Wu, Yee-Shao Chen, Chung-Hsun Huang, and Yuan-Sun Chu. 2023. "Design and Implementation of Machine Tool Life Inspection System Based on Sound Sensing" Sensors 23, no. 1: 284. https://doi.org/10.3390/s23010284
APA StyleLiu, T.-H., Chi, J.-Z., Wu, B.-L., Chen, Y.-S., Huang, C.-H., & Chu, Y.-S. (2023). Design and Implementation of Machine Tool Life Inspection System Based on Sound Sensing. Sensors, 23(1), 284. https://doi.org/10.3390/s23010284