In the integrated processing of large components in the aerospace field, for the end servo industrial robot positioning accuracy needs, often using binocular vision positioning method. This method can accurately measure the end position but is limited by the restricted field of view and small depth of field. So, a monocular camera is needed for servo-guiding the processing end of the robot arm. Therefore, a monocular depth estimation method based on improved Yolov8 and CNN fusion for mobile machining with large field-of-view is proposed in this paper. Firstly, a dataset construction method based on virtual-real fusion is proposed to solve the problem that the depth information corresponding to the training set images is difficult to measure; secondly, the proposed Yolov8sim-CNN cascade neural network can realize the measurement of fast localization and depth prediction of the target machining workpiece and realize the servo-guidance of the robot arm end. The experimental results show that the proposed Yolov8sim-CNN network can ensure high detection accuracy, and the detection accuracy is substantially improved compared with the method of CNN-only, which indicates that the proposed method has better fitting ability and higher accuracy.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.