Evaluation of Metamorphic Testing for Edge Detection in MRI Brain Diagnostics
Abstract
:1. Introduction
Research Contributions
- The novelty of this paper is to study the effectiveness of metamorphic testing applied on MRI brain images. Testing of image processing applications is different from testing of conventional applications, due to the test oracle problem. Previously, metamorphic testing approaches have been applied and evaluated on image processing applications, but there is no previous work on evaluation of metamorphic testing on MRI images. In this work, we have evaluated effectiveness of metamorphic testing on edge detection of MRI images. The aim of this study is to determine which metamorphic relations are more effective for metamorphic testing of edge detection in MRI images such as T1, T2 and flair images.
- Source test cases are generated through a systematic way to ascertain that the generated test cases are random but diverse in nature. Equivalence class testing along with structural testing is used for the generation of source test cases.
- The fault detection effectiveness of four metamorphic relations used in metamorphic testing are evaluated.
- For comparing the outputs of source and follow-up test cases, structure similarity images measure is used.
2. Related Work
2.1. Tumor Detection in MRI Brain Images
2.2. Metamorphic Testing in IPA
2.3. Edge Detection Using Deep Learning
2.4. Pre-Processing Method of Machine Learning for Edge Detection
2.5. Summary of Related Work
- In the literature survey, we have included the papers of edge detection algorithms that are used to identify edges/tumors in MRI brain images. These algorithms are enhancements of traditional edge detection algorithms such as Sobel, Canny, Prewitt, Roberts, etc. The traditional edge detection algorithms are already tested; therefore, testing of these enhanced algorithms is important. We have selected Sari’s improved edge detection algorithm because amongst all the articles, this is the latest research article to detect brain tumor in MRI images.
- In the existing techniques, random testing is considered unbiased for the generation of test cases, but random testing leads to unfair distribution of parametric values. Therefore, we have proposed a criterion where test cases are generated through black-box testing and white-box testing techniques. In the proposed framework, source test cases are selected randomly through the strong equivalence class testing technique, and later, the adequacy of selected test cases is checked through structural testing.
- In the case of image processing operations, sometimes a test oracle cannot be clearly defined, e.g., comparing two images pixel by pixel may show little difference, but visually they are similar. We have used SSIM for the comparison of two images and then calculated the FDR accordingly.
3. Methodology
- Generation of source test cases;
- Identification of MRs;
- Generation of follow-up test cases;
- Comparison of the output of source test cases and output of follow-up test cases.
- Generation of source test cases using black- and white-box testing techniques;
- Identification of MRs;
- Generation of diversified follow-up test cases;
- SSIM-based output comparison: compare the output of source test cases and output of follow-up test cases by using SSIM measure;
- MR strength evaluation: the methodology of the proposed framework is shown in Figure 2.
3.1. Generation of Source Test Cases
3.2. Identification of Metamorphic Relations
3.2.1. Counter-Clockwise Rotation at 90 Degrees
3.2.2. Transposition
3.2.3. Reflection at the Ordinate
3.2.4. Reflection at Abscissa
3.3. Generation of Follow-Up Test Cases
3.4. Evaluation of Metamorphic Relations
- E = Edge detection program and SUT in this case;
- Im = Source test case and could be any image;
- C = Counter-clockwise rotation at 90 degrees;
- C(Im) = Follow-up test case, created by applying counter-clockwise rotation on the source test case.
3.5. SSIM Based Output Comparison
3.6. MR Fault Detection Rate
4. Experiment Design
4.1. Subject Program
- Apply a fast local Laplacian filter on the original image for the enhancement of contrast and texture.
- Convert the image into a grayscale image.
- Apply K-means clustering and fuzzy C-Means clustering.
- Apply traditional Canny edge detection to identify the edges in the MRI of a brain image.
- Apply median filter to smooth out the lines detected in step four.
4.2. Source Code
4.3. Dataset
4.4. Source Test Cases
4.5. Coverage
4.6. Metamorphic Relations
- MR1: C(E(Im)) = E(C(Im))
- MR2: T(E(Im)) = E(T(Im))
- MR3: Mx(E(Im)) = E(Mx(Im))
- MR4: My(E(Im)) = E(My(Im))
5. Results and Discussion
- As shown in Table 10, random camera images are used for the testing of IPAs. We have used a dataset of brain MRIs. To the best of our knowledge, no prior work has been conducted using an MRI dataset in MT.
- In the literature, there is no systematic way to ascertain that the generated test cases are actually random and have diversity to represent all different type of attributes or full coverage. If the sample is not a full representation of the population, then we would obtain biased results affecting the final outcome. In the proposed framework, we have precisely defined procedures to generate source test cases randomly by using black-box and white-box testing.
- In the existing literature, the outputs of two images are compared either manually or pixel by pixel. Sometimes, when comparing the images pixel by pixel, they may have differences which cannot be seen with the naked eye. In the proposed methodology, SSIM is used for the comparison, so we obtain the exact match between the two images.
6. Conclusions and Future Work
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- National Academies of Sciences, Engineering, and Medicine. Improving Diagnosis in Health Care; Quality Chasm Series; The National Academics Press: Washington, DC, USA, 2015. [Google Scholar]
- Brady, P. Error and discrepancy in radiology: Inevitable or avoidable? Insights Imaging 2017, 8, 171–182. [Google Scholar] [CrossRef] [PubMed]
- Liu, H.; Liu, X.; Chen, T.Y. A New Method for Constructing Metamorphic Relations. In Proceedings of the 12th IEEE International Conference on Quality Software, Xi’an, China, 27–29 August 2012. [Google Scholar]
- Sari, C.A.; Sari, W.S.; Rahmalan, H. A Combination of K-Means and Fuzzy C-Means for Brain Tumor Identification. Sci. J. Inform. 2021, 8, 76–83. [Google Scholar] [CrossRef]
- Anwar, N.; Kar, S. Review Paper on Various Software Testing Techniques & Strategies. Glob. J. Comput. Sci. Technol. C Softw. Data Eng. 2019, 19. Available online: https://computerresearch.org/index.php/computer/article/view/1873/1857 (accessed on 5 July 2022).
- Guderlei, R.; Mayer, J. Towards Automatic Testing of Imaging Software by Means of Random and Metamorphic Testing. Int. J. Softw. Eng. Knowl. Eng. 2007, 17, 757–781. [Google Scholar] [CrossRef]
- Jameel, T.; Chao, L. Test Oracles Based on Metamorphic Relations for Image Processing Applications. In Proceedings of the IEEE 16th International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), Takamatsu, Japan, 1–3 June 2015. [Google Scholar]
- Mayer, J. On testing image processing applications with statistical methods. In Software Engineering 2005; Liggesmeyer, P., Pohl, K., Goedicke, M., Eds.; Gesellschaft für Informatik e.V.: Bonn, Germany, 2005; pp. 69–78. [Google Scholar]
- Barr, E.T.; Harman, M.; McMinn, P.; Shahbaz, M.; Yoo, S. The Oracle Problem in Software Testing: A Survey. IEEE Trans. Softw. Eng. 2015, 41, 507–525. [Google Scholar] [CrossRef]
- Just, R.; Schweiggert, F. Evaluating testing strategies for imaging software by means of Mutation Analysis. In Proceedings of the IEEE International Conference on Software Testing Verification and Validation Workshops, Denver, CO, USA, 1–4 April 2009. [Google Scholar]
- Jiang, M.; Chen, T.Y.; Kuo, F.C.; Towey, D.; Ding, Z. A metamorphic testing approach for supporting program repair without the need for a test oracle. J. Syst. Softw. 2017, 126, 127–140. [Google Scholar] [CrossRef]
- Zhou, Z.Q.; Sun, L.; Chen, T.Y.; Towey, D. Metamorphic Relations for Enhancing System Understanding and Use. IEEE Trans. Softw. Eng. 2018, 46, 1120–1154. [Google Scholar] [CrossRef]
- Saha, P.; Kanewala, U. Fault Detection Effectiveness of Metamorphic Relations Developed for Testing Supervised Classifiers. In Proceedings of the International Conference on Artificial Intelligence Testing (AI Test), Newark, CA, USA, 4–9 April 2019. [Google Scholar]
- Zhou, Z.Q.; Xiang, S.; Chen, T.Y. Metamorphic Testing for Software Quality Assessment: A Study of Search Engines. IEEE Trans. Softw. Eng. 2016, 42, 264–284. [Google Scholar] [CrossRef]
- Qiu, K.; Zheng, Z.; Chen, T.Y.; Poon, P. Theoretical and Empirical Analyses of the Effectiveness of Metamorphic Relation Composition. J. Latex Cl. Files 2020, 48, 1001–1017. [Google Scholar] [CrossRef]
- Sim, K.Y.; Wong, D.M.L.; Hii, T.Y. Evaluating the Effectiveness of Metamorphic Testing on Edge Detection Programs. Int. J. Innov. Manag. Technol. 2013, 4, 6–10. [Google Scholar]
- Jiang, C.; Huang, S.; Hui, Z. Metamorphic Testing of Image Region Growth Programs in Image Processing Applications. In Proceedings of the IEEE International Conference on Software Quality, Reliability and Security Companion, Lisbon, Portugal, 16–20 July 2018. [Google Scholar]
- Ding, J.; Hu, X.H. Application of Metamorphic Testing Monitored by Test Adequacy in A Monte Carlo Simulation Program. Softw. Qual. J. 2017, 25, 841–869. [Google Scholar] [CrossRef]
- Ding, K.; Ma, K.; Wang, S.; Simoncelli, E.P. Image Quality Assessment: Unifying Structure and Texture Similarity. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 44, 2567–2581. [Google Scholar] [CrossRef] [PubMed]
- Sara, U.; Akter, M.; Uddin, M.S. Image Quality Assessment through FSIM, SSIM, MSE and PSNR—A Comparative Study. J. Comput. Commun. 2019, 7, 8–18. [Google Scholar] [CrossRef]
- Frackiewicz, M.; Szolc, G.; Palus, H. An Improved SPSIM Index for Image Quality Assessment. Symmetry 2021, 13, 518. [Google Scholar] [CrossRef]
- Stosic, Z.; Rutesic, P. An Improved Canny Edge Detection Algorithm for Detecting Brain Tumors in MRI Images. Int. J. Signal Processing 2018, 3, 11–15. [Google Scholar]
- Zotin, A.; Simonov, K.; Kurako, M.; Hamad, Y.; Kirillova, S. Edge Detection in MRI Brain Tumor Images Based on Fuzzy C- Means Clustering. Procedia Comput. Sci. 2018, 126, 1261–1270. [Google Scholar] [CrossRef]
- Sungheetha, A.; Sharma, R. GTIKF-Gabor-Transform Incorporated K-Means and Fuzzy C Means Clustering for Edge Detection in CT and MRI. J. Soft Comput. Paradig. 2020, 2, 111–119. [Google Scholar] [CrossRef]
- Aslama, A.; Khan, E.; Bega, M.M.S. Improved Edge Detection Algorithm for Brain Tumor Segmentation. In Proceedings of the Second International Symposium on Computer Vision and the Internet, Procedia Computer Science, Kerala, India, 10–13 August 2015. [Google Scholar]
- Hamad, Y.A.; Simonov, K.; Bega, M.B. Brains’s Tumor Detection on Low Contrast Medical Images. In Proceedings of the 1st Annual International Conference on Information and Sciences (AICIS), Fallujah, Iraq, 20–21 November 2018. [Google Scholar]
- Ranjitham, M.; Josephine, M.S.; Jeyabalaraja, V. A Study of an Improved Edge Detection Algorithm for MRI Brain Tumor Images Based on Image Quality Parameters. Turk. J. Comput. Math. Educ. 2021, 12, 2352–2369. [Google Scholar]
- Owny, H.A. An Efficient Edge Detection Algorithm for Noisy Medical Images. World Appl. Sci. J. 2014, 32, 1871–1877. [Google Scholar]
- Somasundaram, K.; Kalaividya, P.A.; Kalaiselvi, T. Edge Detection using Chebyshev’s Orthogonal Polynomial and Application to Brain Segmentation from Magnetic Resonance Images (MRI) of Human Head Scans. Comput. Methods Commun. Tech. Inform. 2019, 29, 110–120. [Google Scholar]
- Hazra, A.; Dey, A.; Gupta, S.K.; Ansari, A. Brain Tumor Detection Based on Segmentation using MATLAB. In Proceedings of the International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS), Chennai, India, 1–2 August 2017. [Google Scholar]
- Khalid, N.E.; Ismail, M.F.; Manaf, M.A.; Fadzil, A.; Ibrahim, S. MRI brain tumor segmentation: A forthright image processing approach. Bull. Electr. Eng. Inform. 2020, 9, 1024–1031. [Google Scholar] [CrossRef]
- Jameel, T.; Mengxiang, L.; Chao, L. A Framework of Automatic Testing of Image Processing applications. In Proceedings of the 13th International Bhurban Conference on Applied Sciences & Technology (IBCAST), Islamabad, Pakistan, 12–16 January 2016. [Google Scholar]
- Jameel, T.; Mengxiang, L.; Chao, L. Automatic Test Oracle for Image Processing Applications Using Support Vector Machines. In Proceedings of the 6th IEEE International Conference on Software Engineering and Service Science (ICSESS), Beijing, China, 23–25 September 2015; pp. 1110–1113. [Google Scholar]
- Chan, W.K.; Ho, J.C.F.; Tse, T.H. Piping Classification to Metamorphic Testing: An Empirical Study towards Better Effectiveness for the Identification of Failures in Mesh Simplification Programs. In Proceedings of the 31st Annual International Computer Software and Applications Conference (COMPSAC 2007), Beijing, China, 24–27 July 2007; Volume 1, pp. 397–404. [Google Scholar]
- Ding, J.; Wu, T.; Lu, J.Q.; Hu, X.H. Self-Checked Metamorphic Testing of an Image Processing Program. In Proceedings of the Fourth IEEE International Conference on Secure Software Integration and Reliability Improvement, Singapore, 9–11 June 2010; pp. 190–197. [Google Scholar]
- Ding, J.; Zhang, D.; Hu, X. An Application of Metamorphic Testing for Testing Scientific Software. In Proceedings of the 1st International Workshop on Metamorphic Testing, Austin, TX, USA, 16 May 2016. [Google Scholar]
- Li, Z.; Jiao, H.; Wang, Y. Edge detection algorithm of cancer image based on deep learning. Bioengineered 2020, 11, 693–707. [Google Scholar] [CrossRef]
- Jamal, T.; Ishak, A.B.; Khalek, S.A. Tumor edge detection in mammography images using quantum and machine learning approaches. Neural Comput. Appl. 2021, 33, 7773–7784. [Google Scholar] [CrossRef]
- Wang, R. Edge Detection Using Convolutional Neural Network; Springer International Publishing: Cham, Switzerland, 2016; pp. 12–20. [Google Scholar]
- Park, K.; Chae, M.; Cho, J.H. Image Pre-Processing Method of Machine Learning for Edge Detection with Image Signal Processor Enhancement. Micromachines 2021, 12, 73. [Google Scholar] [CrossRef] [PubMed]
- Mayer, J.; Guderlei, R. On Random Testing of Image Processing Applications. In Proceedings of the Sixth International Conference on Quality Software (QSIC’06), Beijing, China, 27–28 October 2006. [Google Scholar]
- Just, R.; Schweiggert, F. Automating Unit and Integration Testing with Partial Oracles. Softw. Qual. J. 2011, 19, 753–769. [Google Scholar] [CrossRef]
- Huang, R.; Sun, W.; Xu, Y.; Chen, H.; Towey, D.; Xia, X. A Survey on Adaptive Random Testing. IEEE Trans. Softw. Eng. 2021, 47, 2052–2083. [Google Scholar] [CrossRef]
- Barus, C. The Impact of Source Test case Selection on the Effectiveness of MT. In Proceedings of the 2016 IEEE/ACM 1st International Workshop on Metamorphic Testing (MET), Austin, TX, USA, 16 May 2016. [Google Scholar]
- Zhou, Z.; Zheng, Z.; Chen, T.Y.; Zhou, J.; Qiu, K. Follow-up Test Cases are Better Than Source Test Cases in Metamorphic Testing: A Preliminary Study. In Proceedings of the ICSE, the IEEE/ACM International Conference on Software Engineering, Madrid, Spain, 2 June 2021. [Google Scholar]
- Segura, S.; Parejo, J.A.; Troya, J.; Cort’es, A.R. Metamorphic Testing of RESTful Web APIs. IEEE Trans. Softw. Eng. 2018, 44, 1083–1099. [Google Scholar] [CrossRef]
Ref. Paper | Operation Performed | Input Generation Method | Advantages | Disadvantages |
---|---|---|---|---|
[7] | Dilation, Erosion | Random Input Generation Method | Effectiveness of MRs are identified through mutation testing | Structural testing is not used to check the adequacy of source test cases Images are compared pixel by pixel |
[16] | Sobel Edge Detection | Random Input Generation Method | Edge detection algorithm is used to check the effectiveness of MRs | Structural testing is not used to check the adequacy of source test cases Images are compared pixel by pixel |
[17] | Image Region Growth | Segmental Symbolic Evaluation Method | Effectiveness of MRs are checked through mutation testing | Structural testing is not used to check the adequacy of source test cases Images are compared pixel by pixel |
[18] | Image Reconstruction | Segmental Symbolic Evaluation Method | Use of structural testing along with mutation testing for improving the quality of MR | Images are compared manually |
[32] | Image Smoothing, Dilation and Erosion | Segmental Symbolic Evaluation Method | Automatic framework for IPAs that includes generation and execution of test cases along with output evaluation | Structural testing is not used to check the adequacy of source test cases |
[33] | Dilation | Random Input Generation Method | Automate the test oracle using SVM | Structural testing is not used to check the adequacy of source test cases |
[35] | Image Reconstruction | Random Input Generation Method | Use of structural testing along with mutation testing for improving the quality of MR | Images are compared manually |
Classes | Sub-Classes |
---|---|
Horizontal Dimension | h1: 1–300 h2: 301–650 h3: 651+ |
Vertical Dimension | v1: 1–350 v2: 351–700 v3: 701+ |
Resolution | r1: 1–90 dpi r2: 91–99 dpi r3: 100–450 dpi |
Bit Depth | b1: 8 b2: 24 |
Type of Image | t1: T1-weighted images t2: T2-weighted images t3: flair images |
Summary of Code Coverage | |
---|---|
Total No. of Test Cases | 95 |
Total No. of Statements | 347 |
No. of Covered Statements | 347 |
Statement Coverage (%) | 100% |
Total No. of Branches | 110 |
No. of Covered Branches | 110 |
Branch Coverage (%) | 100% |
Test Cases (TC) | MR1 | MR2 | MR3 | MR4 |
---|---|---|---|---|
TC1 | 0.93 | 0.99 | 0.98 | 0.99 |
TC2 | 0.96 | 0.96 | 1 | 0.96 |
TC3 | 0.98 | 0.99 | 0.98 | 0.93 |
TC4 | 0.95 | 0.98 | 0.97 | 0.92 |
TC5 | 0.99 | 0.99 | 0.99 | 0.99 |
TC6 | 0.81 | 0.99 | 0.95 | 0.91 |
TC7 | 0.92 | 0.98 | 0.93 | 0.94 |
TC8 | 0.99 | 1 | 0.98 | 0.92 |
TC9 | 0.99 | 1 | 0.98 | 0.96 |
TC10 | 0.93 | 0.98 | 0.94 | 0.84 |
TC11 | 0.83 | 0.82 | 1 | 0.82 |
TC12 | 0.92 | 0.97 | 0.93 | 0.95 |
TC13 | 0.98 | 0.94 | 0.94 | 0.94 |
TC14 | 0.79 | 0.97 | 0.97 | 0.89 |
TC15 | 0.89 | 0.96 | 0.95 | 0.84 |
TC16 | 0.94 | 0.98 | 0.92 | 0.9 |
TC17 | 0.94 | 0.82 | 0.91 | 0.89 |
TC18 | 0.98 | 0.99 | 0.98 | 0.97 |
TC19 | 0.94 | 0.98 | 0.94 | 0.95 |
TC20 | 0.98 | 0.99 | 0.96 | 0.95 |
TC21 | 0.96 | 0.97 | 0.97 | 0.96 |
TC22 | 0.87 | 0.99 | 0.87 | 0.9 |
TC23 | 0.95 | 0.98 | 0.84 | 0.93 |
TC24 | 0.88 | 0.94 | 0.72 | 0.78 |
TC25 | 0.98 | 0.99 | 0.89 | 0.94 |
TC26 | 0.95 | 0.97 | 0.96 | 0.92 |
TC27 | 0.95 | 0.99 | 0.96 | 0.92 |
TC28 | 0.98 | 0.98 | 0.96 | 0.98 |
TC29 | 0.93 | 0.97 | 0.9 | 0.87 |
TC30 | 0.91 | 0.98 | 0.95 | 0.88 |
TC31 | 0.97 | 1 | 0.96 | 0.94 |
TC32 | 0.94 | 0.98 | 0.95 | 0.88 |
TC33 | 0.96 | 0.97 | 0.97 | 0.94 |
MR | θ = 0.95 | FDR |
---|---|---|
MR1 | 15 | 54.54% |
MR2 | 29 | 12.12% |
MR3 | 21 | 36.36% |
MR4 | 12 | 63.63% |
Test Cases (TC) | MR1 | MR2 | MR3 | MR4 |
---|---|---|---|---|
TC1 | 0.97 | 0.99 | 0.94 | 0.94 |
TC2 | 0.94 | 0.89 | 0.97 | 0.93 |
TC3 | 0.75 | 0.75 | 0.93 | 0.92 |
TC4 | 0.92 | 0.76 | 0.76 | 0.76 |
TC5 | 0.92 | 0.99 | 0.92 | 0.96 |
TC6 | 0.94 | 0.84 | 0.96 | 0.95 |
TC7 | 0.98 | 0.99 | 0.99 | 0.97 |
TC8 | 0.93 | 0.96 | 0.95 | 0.93 |
TC9 | 0.88 | 0.99 | 0.95 | 0.88 |
TC10 | 0.85 | 0.99 | 0.93 | 0.96 |
TC11 | 0.95 | 0.97 | 0.91 | 0.85 |
TC12 | 0.97 | 0.99 | 0.94 | 0.93 |
TC13 | 0.97 | 0.86 | 1 | 0.91 |
TC14 | 0.97 | 0.99 | 0.9 | 0.97 |
TC15 | 0.96 | 0.88 | 0.87 | 0.95 |
TC16 | 0.95 | 0.96 | 0.96 | 0.91 |
TC17 | 0.95 | 0.98 | 0.96 | 0.89 |
TC18 | 0.93 | 0.95 | 0.94 | 0.87 |
TC19 | 0.98 | 0.86 | 0.98 | 0.85 |
TC20 | 0.9 | 0.96 | 0.93 | 0.9 |
TC21 | 0.95 | 0.97 | 0.97 | 0.93 |
TC22 | 0.94 | 0.98 | 0.96 | 0.84 |
TC23 | 0.91 | 0.83 | 0.93 | 0.93 |
TC24 | 0.86 | 0.98 | 0.92 | 0.9 |
TC25 | 0.83 | 0.97 | 0.95 | 0.91 |
TC26 | 0.98 | 0.98 | 0.97 | 0.95 |
TC27 | 0.96 | 0.98 | 0.98 | 0.96 |
TC28 | 0.95 | 0.97 | 0.96 | 0.92 |
TC29 | 0.95 | 0.98 | 0.98 | 0.94 |
MR | θ = 0.95 | FDR |
---|---|---|
MR1 | 15 | 48.27% |
MR2 | 21 | 27.58% |
MR3 | 16 | 44.82% |
MR4 | 8 | 72.41% |
Test Cases (TC) | MR1 | MR2 | MR3 | MR4 |
---|---|---|---|---|
TC1 | 0.98 | 0.97 | 0.97 | 0.98 |
TC2 | 0.95 | 0.96 | 0.98 | 0.97 |
TC3 | 1 | 0.99 | 1 | 0.99 |
TC4 | 0.99 | 0.99 | 0.99 | 0.98 |
TC5 | 0.84 | 0.96 | 0.94 | 0.94 |
TC6 | 0.96 | 0.97 | 0.97 | 0.95 |
TC7 | 0.97 | 0.99 | 0.95 | 0.97 |
TC8 | 0.98 | 0.99 | 0.99 | 0.98 |
TC9 | 0.91 | 0.96 | 0.91 | 0.89 |
TC10 | 0.96 | 0.98 | 0.98 | 0.92 |
TC11 | 0.98 | 0.99 | 0.92 | 0.97 |
TC12 | 0.99 | 1 | 0.99 | 0.97 |
TC13 | 0.98 | 1 | 0.98 | 0.97 |
TC14 | 0.84 | 0.98 | 0.96 | 0.97 |
TC15 | 0.99 | 0.97 | 0.98 | 0.99 |
TC16 | 0.87 | 0.97 | 0.93 | 0.76 |
TC17 | 1 | 1 | 1 | 0.98 |
TC18 | 0.96 | 0.98 | 0.97 | 0.97 |
TC19 | 1 | 0.99 | 1 | 0.99 |
TC20 | 0.98 | 0.99 | 0.98 | 0.98 |
TC21 | 0.99 | 0.99 | 0.99 | 0.99 |
TC22 | 0.97 | 0.98 | 0.97 | 0.95 |
TC23 | 0.94 | 0.91 | 0.91 | 0.98 |
TC24 | 0.95 | 0.98 | 0.87 | 0.93 |
TC25 | 0.99 | 0.99 | 0.99 | 0.99 |
TC26 | 0.97 | 1 | 0.94 | 0.92 |
TC27 | 0.99 | 0.96 | 0.98 | 0.99 |
TC28 | 0.96 | 0.98 | 0.96 | 0.96 |
TC29 | 0.92 | 0.96 | 0.77 | 0.83 |
TC30 | 0.94 | 0.97 | 0.95 | 0.92 |
TC31 | 0.91 | 0.98 | 0.97 | 0.96 |
TC32 | 0.96 | 0.99 | 0.97 | 0.97 |
TC33 | 0.92 | 0.99 | 0.99 | 0.94 |
MR | θ = 0.95 | FDR |
---|---|---|
MR1 | 24 | 27.27% |
MR2 | 32 | 3.03% |
MR3 | 25 | 24.24% |
MR4 | 24 | 27.27% |
MT Related Research | Dataset | Image Comparison Method | Input Generation Method |
---|---|---|---|
[7] | Random Camera Images | Pixel by pixel | Random Input Generation |
[16] | Random Camera Images | Pixel by pixel | Random Input Generation |
[17] | Random Camera Images | Pixel by pixel | Segmental Symbolic Evaluation Method |
[18] | Biological Cells | Manual | Segmental Symbolic Evaluation Method |
[35] | Biological Cells | Manual | Random Input Generation |
Proposed Methodology | MRI brain Images | Structure Similarity Image Measure | Strong equivalence class testing and structural testing |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Jafari, F.; Nadeem, A.; Zaman, Q.u. Evaluation of Metamorphic Testing for Edge Detection in MRI Brain Diagnostics. Appl. Sci. 2022, 12, 8684. https://doi.org/10.3390/app12178684
Jafari F, Nadeem A, Zaman Qu. Evaluation of Metamorphic Testing for Edge Detection in MRI Brain Diagnostics. Applied Sciences. 2022; 12(17):8684. https://doi.org/10.3390/app12178684
Chicago/Turabian StyleJafari, Fakeeha, Aamer Nadeem, and Qamar uz Zaman. 2022. "Evaluation of Metamorphic Testing for Edge Detection in MRI Brain Diagnostics" Applied Sciences 12, no. 17: 8684. https://doi.org/10.3390/app12178684
APA StyleJafari, F., Nadeem, A., & Zaman, Q. u. (2022). Evaluation of Metamorphic Testing for Edge Detection in MRI Brain Diagnostics. Applied Sciences, 12(17), 8684. https://doi.org/10.3390/app12178684