Part defect recognition based on 2D and 3D feature combination

Hui Mo; Hongzhi Jiang; Huijie Zhao; Xudong Li; Na Li

doi:10.1117/12.2548258

16 October 2019 Part defect recognition based on 2D and 3D feature combination

Hui Mo, Hongzhi Jiang, Huijie Zhao, Xudong Li, Na Li

Proceedings Volume 11205, Seventh International Conference on Optical and Photonic Engineering (icOPEN 2019); 112051F (2019) https://doi.org/10.1117/12.2548258
Event: Seventh International Conference on Optical and Photonic Engineering (icOPEN 2019), 2019, Phuket, Thailand

Abstract

Surface defect recognition is used to test product’s quality. The current way of recognition is traditional 2D imagebased method. But 2D image lacks 3D information which results in false inspection and missed inspection, which has become a bottleneck of current classification model. Because of the recent rapid development of 3D measurement technology, we can apply 3D data information in surface defect detection to improve the recognition ability of defects. We propose a new convolutional network model to identify surface defects, and realize the feature depth fusion of 3D point cloud and 2D image in the model. In this work, we introduce an attention network to extract features from a 3D point cloud to generate a 2D attention mask. The high quality feature map is produced by combining the 2D attention mask with a 2D image. We further merge the attention network and the classification network into a single network. The attention network is used to analyze which part of the image should be more concerned by the classification network. Therefore, mutual learning of 2D data and 3D data is realized in the training process, which reduces the dependence on the number of samples and enhances the generalization performance of the model. Experiments on the defect dataset verify that our method can improve the classification effect of the model.

Citation Download Citation

Hui Mo, Hongzhi Jiang, Huijie Zhao, Xudong Li, and Na Li "Part defect recognition based on 2D and 3D feature combination", Proc. SPIE 11205, Seventh International Conference on Optical and Photonic Engineering (icOPEN 2019), 112051F (16 October 2019); https://doi.org/10.1117/12.2548258

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available