Image-Based Surface Defect Detection Using Deep Learning: A Review

Park, 2009, Automated Defect Inspection Systems by Pattern Recognition, Int. J. Signal Process., Image Process. Pattern Recognit., 2, 31

Tsa, 2000, Automated Surface Inspection Using Gabor Filters, Int. J. Adv. Manuf. Technol., 16, 474, 10.1007/s001700070055

Tsai, 2003, Automated Surface Inspection for Statistical Textures, Image Vis. Comput., 21, 307, 10.1016/S0262-8856(03)00007-6

Samarawickrama, 2017, Matlab Based Automated Surface Defect Detection System for Ceremic Tiles Using Image Processing, 34

Elbehiery, 2005, Surface Defects Detection for Ceramic Tiles Using Image Processing and Morphological Techniques, Egyptian Inf. J., 6, 123

Iivarinen, 2000, Surface Defect Detection With Histogram-Based Texture Features, 140

Jie, 2009, Real-Time Rail Head Surface Defect Detection: A Geometrical Approach, 769

Huang, 2018, Surface Defect Saliency of Magnetic Tile, 612

Jia, 2004, An Intelligent Real-Time Vision System for Surface Defect Detection, 239

Xue-Wu, 2011, A Vision Inspection System for the Surface Defects of Strongly Reflected Metal Based on Multi-Class SVM, Expert Syst. Appl., 38, 5930, 10.1016/j.eswa.2010.11.030

Shanmugamani, 2015, Detection and Classification of Surface Defects of Gun Barrels Using Computer Vision and Machine Learning, Measurement, 60, 222, 10.1016/j.measurement.2014.10.009

Li, 2002, Computer Vision Based System for Apple Surface Defect Detection, Comput. Electron. Agric., 36, 215, 10.1016/S0168-1699(02)00093-5

Pastor-López, 2012, Machine-Learning-Based Surface Defect Detection and Categorisation in High-Precision Foundry, 1359

Tao, 2018, Automatic Metallic Surface Defect Detection and Recognition With Convolutional Neural Networks, Appl. Sci., 8, 1575, 10.3390/app8091575

Xie, 2008, A Review of Recent Advances in Surface Defect Detection Using Texture Analysis Techniques, ELCVIA: Electron. Lett. Comput. Vis. Image Anal., 7, 1, 10.5565/rev/elcvia.268

Patel, 2016, Survey on Different Methods for Defect Detection, Int., Res. J. Eng. Tech., 3, 1217

Hoang, 2019, A Survey on Deep Learning Based Bearing Fault Diagnosis, Neurocomputing, 335, 327, 10.1016/j.neucom.2018.06.078

Cao, 2020, Review of Pavement Defect Detection Methods, IEEE Access, 8, 14531, 10.1109/ACCESS.2020.2966881

Luo, 2020, Automated Visual Defect Detection for Flat Steel Surface: A Survey, IEEE Trans. Instrum. Meas., 69, 626, 10.1109/TIM.2019.2963555

Kumar, 2008, Computer-Vision-Based Fabric Defect Detection: A Survey, IEEE Trans. Ind. Electron., 55, 348, 10.1109/TIE.1930.896476

Fouzia, 2010, A Literature Survey on Various Methods Used for Metal Defects Detection Using Image Segmentation, Evaluation, 5, 8

Czimmermann, 2020, Visual-Based Defect Detection and Classification Approaches for Industrial Applications—A Survey, Sensors, 20, 1459, 10.3390/s20051459

Ahuja, 2017, A Survey of Computer Vision Based Corrosion Detection Approaches, 55

Goodfellow, 2016, Deep Learning

Goodfellow, 2014, Generative Adversarial Nets, 2672

Kohonen, 1990, The Self-organizing Map, Proc. IEEE, 78, 1464, 10.1109/5.58325

He, 2016, Deep Residual Learning for Image Recognition, 770

Iandola, 2016, Squeezenet: Alexnet-Level Accuracy With 50x Fewer Parameters and <0.5 mb Model Size

Yu, 2017, Fully Convolutional Networks for Surface Defect Inspection in Industrial Environment, 417

Lin, 2019, Research on Texture Defect Detection Based on Faster-RCNN and Feature Fusion, 429

DAGM Data Set

NEU Data Set

COCO Data Set

He, 2020, Deep Regression Neural Network for Industrial Surface Defect Detection, IEEE Access, 8, 35 583, 10.1109/ACCESS.2020.2975030

Hochreiter, 1997, Long Short-Term Memory, Neural Comput., 9, 1735, 10.1162/neco.1997.9.8.1735

Li, 2018, Research on a Surface Defect Detection Algorithm Based on Mobilenet-SSD, Appl. Sci., 8, 1678, 10.3390/app8091678

Simonyan, 2015, Very Deep Convolutional Networks for Large-Scale Image Recognition

Brinkmann, 2008, The Art and Science of Digital Compositing: Techniques for Visual Effects, Animation and Motion Graphics

Schaul, 2010, Metalearning, Scholarpedia, 5, 4650, 10.4249/scholarpedia.4650

Jolliffe, 1986, Principal Component Analysis, 10.1007/978-1-4757-1904-8

Chandola, 2009, Anomaly Detection: A Survey, ACM J., 41, 1

Chalapathy, 2019, Deep Learning for Anomaly Detection: A Survey

Kiran, 2018, An Overview of Deep Learning Based Methods for Unsupervised and Semi-Supervised Anomaly Detection in Videos, J. Imagine, 4

Wulsin, 2010, Semi-Supervised Anomaly Detection for Eeg Waveforms Using Deep Belief Nets, 436

Song, 2017, A Hybrid Semi-Supervised Anomaly Detection Model for High-Dimensional Data, J. Comput. Intell. Neurosci., 2017

Ruff, 2019, Deep Semi-Supervised Anomaly Detection

Schlegl, 2017, Information Processing in Medical Imaging, 146, 10.1007/978-3-319-59050-9_12

Ruff, 2018, Proceedings of the 35th International Conference on Machine Learning, 4393

Xu, 2018, Research on Target Detection Methods Under the Concept of Deep Learning, J. Phys.: Conference Ser., 1087, 062055

Wang, 2017, Grid-Based Pavement Crack Analysis Using Deep Learning, 917

Xie, 2020, Ffcnn: A Deep Neural Network for Surface Defect Detection of Magnetic Tile, IEEE Trans. Ind. Electron., 68, 1

Maestro-Watson, 2018, Deep Learning for Deflectometric Inspection of Specular Surfaces, 280

Fu, 2019, A Deep-Learning-Based Approach for Fast and Robust Steel Surface Defects Classification, Optics Lasers Eng., 121, 397, 10.1016/j.optlaseng.2019.05.005

Racki, Towards Surface Anomaly Detection With Deep Learning, 437

Wu, 2017, A Surface Defect Detection Based on Convolutional Neural Network, 185

Soukup, 2014, Convolutional Neural Networks for Steel Surface Defect Detection From Photometric Stereo Images, 668

Azizah, 2017, Deep Learning Implementation Using Convolutional Neural Network in Mangosteen Surface Defect Detection, 242

Cha, 2017, Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks, Comput. Aided Civil Infrastructure Eng., 32, 361, 10.1111/mice.12263

Ren, 2017, A Generic Deep-Learning-Based Approach for Automated Surface Inspection, IEEE Trans. Cybern., 48, 929, 10.1109/TCYB.2017.2668395

Kang, 2018, Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder With Multitask Learning, IEEE Trans. Instrum. Meas., 68, 2679, 10.1109/TIM.2018.2868490

Lien, 2018, Product Surface Defect Detection Based on Deep Learning, 250

Tout, 2019, Automated Vision System for Crankshaft Inspection Using Deep Learning Approaches, 111720N

Song, 2018, Detection of Micro-Defects on Metal Screw Surfaces Based on Deep Convolutional Neural Networks, Sensors, 18, 3709, 10.3390/s18113709

Xu, 2019, Sdd-cnn: Small Data-Driven Convolution Neural Networks for Subtle Roller Defect Inspection, Appl. Sci., 9, 1364, 10.3390/app9071364

Sun, 2019, Surface Defects Recognition of Wheel Hub Based on Improved Faster R-CNN, Electronics, 8, 481, 10.3390/electronics8050481

Wang, 2018, A Fast and Robust Convolutional Neural Network-Based Defect Detection Model in Product Quality Control, Int. J. Adv. Manuf. Technol., 94, 3465, 10.1007/s00170-017-0882-0

Qiu, 2019, A High-Efficiency Fully Convolutional Networks for Pixel-Wise Surface Defect Detection, IEEE Access, 7, 15 884, 10.1109/ACCESS.2019.2894420

Lai, 2018, A Texture Generation Approach for Detection of Novel Surface Defects, 4357

S vison, 2018, A Convolutional Neural Network for Segmentation of Background Texture and Defect on Copper Clad Lamination Surface, 1

Faghih-Roohi, 2016, Deep Convolutional Neural Networks for Detection of Rail Surface Defects, 2584

Lian, 2020, Deep-Learning-Based Small Surface Defect Detection Via an Exaggerated Local Variation-Based Generative Adversarial Network, IEEE Trans. Ind. Inform., 16, 1343, 10.1109/TII.2019.2945403

Li, 2019, Application of Multi-Scale Feature Fusion and Deep Learning in Detection of Steel Strip Surface Defect, 656

Xu, 2020, A Weakly Supervised Surface Defect Detection Based on Convolutional Neural Network, IEEE Access, 8, 42 285, 10.1109/ACCESS.2020.2977821

Khumaidi, 2017, Welding Defect Classification Based on Convolution Neural Network (CNN) and Gaussian Kernel, 261

Park, 2016, Machine Learning-Based Imaging System for Surface Defect Inspection, Int. J. Precision Eng. Manuf. Green Technol., 3, 303, 10.1007/s40684-016-0039-x

Deng, 2020, Extremal Region Analysis Based Deep Learning Framework for Detecting Defects

Yuan, 2018, Vision-Based Defect Detection for Mobile Phone Cover Glass Using Deep Neural Networks, Int. J. Precision Eng. Manuf. Green Technol., 19, 801, 10.1007/s12541-018-0096-x

Wei, 2019, Research on Recognition Technology of Aluminum Profile Surface Defects Based on Deep Learning, Materials, 12, 1681, 10.3390/ma12101681

Staar, 2019, Anomaly Detection With Convolutional Neural Networks for Industrial Surface Inspection, Procedia CIRP, 79, 484, 10.1016/j.procir.2019.02.123

Li, 2016, Deformable Patterned Fabric Defect Detection With Fisher Criterion-Based Deep Learning, IEEE Trans. Autom. Sci. Eng., 14, 1256, 10.1109/TASE.2016.2520955

Natarajan, 2017, Convolutional Networks for Voting-Based Anomaly Classification in Metal Surface Inspection, 986

Zhang, 2020, Deep-Learning-Based Porosity Monitoring of Laser Welding Process, Manuf. Lett., 23, 62, 10.1016/j.mfglet.2020.01.001

Mujeeb, 2018, Unsupervised Surface Defect Detection Using Deep Autoencoders and Data Augmentation, 391

Volkau, 2019, Detection Defect in Printed Circuit Boards Using Unsupervised Feature Extraction Upon Transfer Learning, 101

Mei, 2018, An Unsupervised-Learning-Based Approach for Automated Defect Inspection on Textured Surfaces, IEEE Trans. Instrum. Meas., 67, 1266, 10.1109/TIM.2018.2795178

Zhang, 2017, Automated Pixel-Level Pavement Crack Detection on 3d Asphalt Surfaces Using a Deep-Learning Network, Comput. Aided Civil Infrastructure Eng., 32, 805, 10.1111/mice.12297

Masci, 2012, Steel Defect Classification With Max-Pooling Convolutional Neural Networks, 1

Racki, 2018, The Effect of Different CNN Configurations on Textured-Surface Defect Segmentation and Detection Performance

Liong, 2019, Automatic Defect Segmentation on Leather With Deep Learning

Akhyar, 2019, High Efficient Single-Stage Steel Surface Defect Detection, 1

Akhyar, 2019, Cascading Convolutional Neural Network for Steel Surface Defect Detection, 202

Li, 2020, Rail Surface Defect Detection Based on Deep Learning, 113730K

Cheon, 2019, Convolutional Neural Network for Wafer Surface Defect Classification and the Detection of Unknown Defect Class, IEEE Trans. Semiconductor Manuf., 32, 163, 10.1109/TSM.2019.2902657

Yuan, 2019, A Deep Convolutional Neural Network for Detection of Rail Surface Defect, 1

He, 2019, An End-to-End Steel Surface Defect Detection Approach Via Fusing Multiple Hierarchical Features, IEEE Trans. Instrum. Meas., 69, 1493, 10.1109/TIM.2019.2915404

Dong, 2019, Pga-net: Pyramid Feature Fusion and Global Context Attention Network for Automated Surface Defect Detection, IEEE Trans. Ind. Inform., 16, 7448, 10.1109/TII.2019.2958826

Gu, 2020, Research on Intelligent Detection Technology of Surface Defects of Nuclear Fuel Rods Based on Machine Vision, 927

Mujeeb, 2019, One Class Based Feature Learning Approach for Defect Detection Using Deep Autoencoders, Adv. Eng. Inform., 42, 100933, 10.1016/j.aei.2019.100933

Di, 2019, Surface Defect Classification of Steels With a New Semi-Supervised Learning Method, Optics Lasers Eng., 117, 40, 10.1016/j.optlaseng.2019.01.011

Li, 2018, A VGG-16 Based Faster RCNN Model for PCB Error Inspection in Industrial AOI Applications, 10.1109/ICCE-China.2018.8448674

Baumgartl, 2020, A Deep Learning-Based Model for Defect Detection in Laser-Powder Bed Fusion Using In-Situ Thermographic Monitoring, Progress in Addtive Manuf., 2020, 1

Qu, 2018, Partsnet: A Unified Deep Network for Automotive Engine Precision Parts Defect Detection, 594

Chen, 2017, Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network, IEEE Trans. Instrum. Meas., 67, 257, 10.1109/TIM.2017.2775345

Tabernik, 2019, Segmentation-Based Deep-Learning Approach for Surface-Defect Detection, J. Intell. Manuf., 31, 1

Chen, 2018, Solar Cell Surface Defect Inspection Based on Multispectral Convolutional Neural Network, J. Intell. Manuf., 31, 1

Weimer, 2016, Design of Deep Convolutional Neural Network Architectures for Automated Feature Extraction in Industrial Inspection, CIRP. Ann., 65, 417, 10.1016/j.cirp.2016.04.072

Shang, 2018, Detection of Rail Surface Defects Based on CNN Image Recognition and Classification, 45

Konrad, 2019, Surface Defect Detection for Automated Inspection Systems Using Convolutional Neural Networks, 75

Liu, 2019, Periodic Surface Defect Detection in Steel Plates Based on Deep Learning, Appl. Sci., 9, 3127, 10.3390/app9153127

Xiao, 2020, Surface Defect Detection Using Image Pyramid, IEEE Sens. J., 20, 7181, 10.1109/JSEN.2020.2977366

Xiao, 2020, Detection of Powder Bed Defects in Selective Laser Sintering Using Convolutional Neural Network, Int. J. Adv. Manuf. Technol., 1

Cui, 2020, Metal Additive Manufacturing Parts Inspection Using Convolutional Neural Network, Appl. Sci., 10, 545, 10.3390/app10020545

Hartl, 2019, Automated Visual Inspection of Friction Stir Welds: A Deep Learning Approach, 1105909

Li, 2018, Pixel-Wise Crack Detection Using Deep Local Pattern Predictor for Robot Application, Sensors, 18, 3042, 10.3390/s18093042

Sun, 2018, Research Progress of Visual Inspection Technology of Steel Products-A-a Review, Appl. Sci., 8, 2195, 10.3390/app8112195

Kholief, 2017, Detection of Steel Surface Defect Based on Machine Learning Using Deep Auto-Encoder Network, Ind. Eng. Oper. Manage., 218

Shi, 2016, Automatic Road Crack Detection Using Random Structured Forests, IEEE Trans. Intell. Transp. Syst., 17, 3434, 10.1109/TITS.2016.2552248

Gan, 2017, A Hierarchical Extractor-Based Visual Rail Surface Inspection System, IEEE Sens. J., 17, 7935, 10.1109/JSEN.2017.2761858

Silvestre-Blanes, 2019, A Public Fabric Database for Defect Detection Methods and Results, Autex Res. J., 19, 363, 10.2478/aut-2019-0035

Song, 2013, Micro Surface Defect Detection Method for Silicon Steel Strip Based on Saliency Convex Active Contour Model, Math. Probl. Eng., 2013, 10.1155/2013/429094

Girshick, 2014, Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation, 580

Girshick, 2015, Fast R-CNN, 1440

Ren, 2015, Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks, 91

Shorten, 2019, A Survey on Image Data Augmentation for Deep Learning, J. Big Data, 6, 1106, 10.1186/s40537-019-0197-0

Xie, 2020, Explainable Deep Learning: A Field Guide for the Uninitiated

Poggio, 2017, Theory of Deep Learning III: Explaining the Non-Overfitting Puzzle

Pan, 2009, A Survey on Transfer Learning, IEEE Trans. Knowl. Data Eng., 22, 1345, 10.1109/TKDE.2009.191

Samet, 2016, Primer Defects Detection on Military Cartridge Cases, 96

Lin, 2017, Feature Pyramid Networks for Object Detection, 2117

Hao, 2017, Scale-Aware Face Detection, 6186

Welleck, 2017, Saliency-Based Sequential Image Attention With Multiset Prediction, 5173

Fang, 2017, Object Detection Meets Knowledge Graphs, 1661

Gavrishchaka, 2019, Synergy of Physics-Based Reasoning and Machine Learning in Biomedical Applications: Towards Unlimited Deep Learning With Limited Data, Adv. Phys.: X, 4, 1582361