Breast Morphology Recognition and Control Based on Uncalibrated Vision

Breast cancer has become the cancer with the highest incidence rate in the world. Robot-assisted puncture is gradually being applied to breast puncture biopsy procedures. In this paper, to address the problem of lesion drift existing in the current work of breast puncture robots, a breast tissue man...

Full description

Saved in:
Bibliographic Details
Main Authors: Haiyan Du, Jianxin Li, Cheng Qian, Qiang Liu, Zhimeng Zhang
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10743184/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850162014407622656
author Haiyan Du
Jianxin Li
Cheng Qian
Qiang Liu
Zhimeng Zhang
author_facet Haiyan Du
Jianxin Li
Cheng Qian
Qiang Liu
Zhimeng Zhang
author_sort Haiyan Du
collection DOAJ
description Breast cancer has become the cancer with the highest incidence rate in the world. Robot-assisted puncture is gradually being applied to breast puncture biopsy procedures. In this paper, to address the problem of lesion drift existing in the current work of breast puncture robots, a breast tissue manipulation system based on uncalibrated vision is designed to manipulate breast tissue to move the puncture target to a position that is easy to puncture, optimizing the puncture path to reduce procedure failure rates. Firstly, the Canny operator and SURF algorithm extract the target contour and features from the breast images captured by the camera. An improved algorithm combining stochastic Hough transform and direct least squares is proposed to enhance the accuracy of the target localization in the images. Secondly, uncalibrated vision is introduced into breast tissue manipulation, the image-deformation Jacobi matrix is derived from the system model. Then, the online estimation of the image-deformation Jacobi matrix is carried out using the Unscented Kalman Filter (UKF) algorithm. The robotic arm is controlled by the vision controller to accomplish the manipulation task. Simulations verify the high performance of the control scheme based on the UKF algorithm for online estimation of the image-deformation Jacobian matrix. Finally, breast tissue manipulation experimental results show that the manipulation system successfully shifts the breast tissue deformation target to the desired target position, and the manipulation accuracy meets the clinical requirements. The breast tissue morphology control is achieved, which verifies the effectiveness and feasibility of the design in this paper.
format Article
id doaj-art-0b7748ceb9ab40b28ca6571a7f4c0c26
institution OA Journals
issn 2169-3536
language English
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-0b7748ceb9ab40b28ca6571a7f4c0c262025-08-20T02:22:40ZengIEEEIEEE Access2169-35362024-01-011217238517239510.1109/ACCESS.2024.349183710743184Breast Morphology Recognition and Control Based on Uncalibrated VisionHaiyan Du0https://orcid.org/0000-0001-5049-9725Jianxin Li1Cheng Qian2Qiang Liu3Zhimeng Zhang4Key Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin, ChinaKey Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin, ChinaKey Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin, ChinaKey Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin, ChinaKey Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin, ChinaBreast cancer has become the cancer with the highest incidence rate in the world. Robot-assisted puncture is gradually being applied to breast puncture biopsy procedures. In this paper, to address the problem of lesion drift existing in the current work of breast puncture robots, a breast tissue manipulation system based on uncalibrated vision is designed to manipulate breast tissue to move the puncture target to a position that is easy to puncture, optimizing the puncture path to reduce procedure failure rates. Firstly, the Canny operator and SURF algorithm extract the target contour and features from the breast images captured by the camera. An improved algorithm combining stochastic Hough transform and direct least squares is proposed to enhance the accuracy of the target localization in the images. Secondly, uncalibrated vision is introduced into breast tissue manipulation, the image-deformation Jacobi matrix is derived from the system model. Then, the online estimation of the image-deformation Jacobi matrix is carried out using the Unscented Kalman Filter (UKF) algorithm. The robotic arm is controlled by the vision controller to accomplish the manipulation task. Simulations verify the high performance of the control scheme based on the UKF algorithm for online estimation of the image-deformation Jacobian matrix. Finally, breast tissue manipulation experimental results show that the manipulation system successfully shifts the breast tissue deformation target to the desired target position, and the manipulation accuracy meets the clinical requirements. The breast tissue morphology control is achieved, which verifies the effectiveness and feasibility of the design in this paper.https://ieeexplore.ieee.org/document/10743184/Breast tissuemorphological controltarget recognition and localizationuncalibrated vision
spellingShingle Haiyan Du
Jianxin Li
Cheng Qian
Qiang Liu
Zhimeng Zhang
Breast Morphology Recognition and Control Based on Uncalibrated Vision
IEEE Access
Breast tissue
morphological control
target recognition and localization
uncalibrated vision
title Breast Morphology Recognition and Control Based on Uncalibrated Vision
title_full Breast Morphology Recognition and Control Based on Uncalibrated Vision
title_fullStr Breast Morphology Recognition and Control Based on Uncalibrated Vision
title_full_unstemmed Breast Morphology Recognition and Control Based on Uncalibrated Vision
title_short Breast Morphology Recognition and Control Based on Uncalibrated Vision
title_sort breast morphology recognition and control based on uncalibrated vision
topic Breast tissue
morphological control
target recognition and localization
uncalibrated vision
url https://ieeexplore.ieee.org/document/10743184/
work_keys_str_mv AT haiyandu breastmorphologyrecognitionandcontrolbasedonuncalibratedvision
AT jianxinli breastmorphologyrecognitionandcontrolbasedonuncalibratedvision
AT chengqian breastmorphologyrecognitionandcontrolbasedonuncalibratedvision
AT qiangliu breastmorphologyrecognitionandcontrolbasedonuncalibratedvision
AT zhimengzhang breastmorphologyrecognitionandcontrolbasedonuncalibratedvision