Smart surgical telementoring system with patch-to-pixel point tracking method
The utilization of surgical telementoring has become increasingly prevalent in enhancing the surgical standards of grassroots hospitals in contemporary times. In the traditional framework of surgical telementoring, remote doctors guide grassroots doctors via video and audio communication, which may...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-03-01
|
| Series: | EngMedicine |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2950489925000041 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832576426813947904 |
|---|---|
| author | Yanwei Qu Ling Li Tongtong Li Jieyu Zheng Wentao Tang Xiaojian Li |
| author_facet | Yanwei Qu Ling Li Tongtong Li Jieyu Zheng Wentao Tang Xiaojian Li |
| author_sort | Yanwei Qu |
| collection | DOAJ |
| description | The utilization of surgical telementoring has become increasingly prevalent in enhancing the surgical standards of grassroots hospitals in contemporary times. In the traditional framework of surgical telementoring, remote doctors guide grassroots doctors via video and audio communication, which may encounter obstacles such as inadequate information transfer and challenges in accurately pinpointing the surgical site and path. To mitigate these issues, this study introduces an intelligent surgical telementoring system based on edge computing. This system enables the transmission of points marked by remote doctors to grassroots doctors, updating these points’ coordinates in real-time on the local endoscopic video. In this system, a novel method named P2PTracking (Patch-to-Pixel Point Tracking) is implemented. This process begins with the tracking of a square patch surrounding the point marked by the remote doctor using SiameseFC. Following this, feature matching is performed on the tracked patch in the current frame and the square patch in the labelled frame or template frame. The affine transformation is then calculated based on the feature matching results. Lastly, the point tracking result is derived using the computed affine transformation. Experimental results indicate that the proposed system has a transmission speed of 1.99M/s and a transmission latency of 171 ms when transmitting video at a resolution of 1920 × 1080px, while the proposed method can achieve an accuracy of 96.6 % when the pixel error is 4. The code and data are available at https://github.com/hfut66/P2PTracking.git. |
| format | Article |
| id | doaj-art-a4ac570f3eca42ff892fbd249f163eba |
| institution | Kabale University |
| issn | 2950-4899 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | Elsevier |
| record_format | Article |
| series | EngMedicine |
| spelling | doaj-art-a4ac570f3eca42ff892fbd249f163eba2025-01-31T05:12:53ZengElsevierEngMedicine2950-48992025-03-0121100058Smart surgical telementoring system with patch-to-pixel point tracking methodYanwei Qu0Ling Li1Tongtong Li2Jieyu Zheng3Wentao Tang4Xiaojian Li5School of Management, Hefei University of Technology, Hefei, 230009, Anhui, ChinaSchool of Management, Hefei University of Technology, Hefei, 230009, Anhui, China; Philosophy and Social Sciences Laboratory of Data Science and Smart Society Governance, Ministry of Education, Hefei, 230009, Anhui, China; Corresponding author. School of Management, Hefei University of Technology, Hefei, 230009, Anhui, China.School of Management, Hefei University of Technology, Hefei, 230009, Anhui, China; Key Laboratory of Process Optimization and Intelligent Decision-making, Ministry of Education, Hefei, 230009, Anhui, ChinaSchool of Management, Hefei University of Technology, Hefei, 230009, Anhui, China; Key Laboratory of Process Optimization and Intelligent Decision-making, Ministry of Education, Hefei, 230009, Anhui, ChinaHefei Haochuan Information Technology Co.,Ltd, Hefei, 230088, Anhui, ChinaSchool of Management, Hefei University of Technology, Hefei, 230009, Anhui, China; Ministry of Education Engineering Research Center for Intelligent Decision-Making Information System Technologies, Hefei, 230009, Anhui, ChinaThe utilization of surgical telementoring has become increasingly prevalent in enhancing the surgical standards of grassroots hospitals in contemporary times. In the traditional framework of surgical telementoring, remote doctors guide grassroots doctors via video and audio communication, which may encounter obstacles such as inadequate information transfer and challenges in accurately pinpointing the surgical site and path. To mitigate these issues, this study introduces an intelligent surgical telementoring system based on edge computing. This system enables the transmission of points marked by remote doctors to grassroots doctors, updating these points’ coordinates in real-time on the local endoscopic video. In this system, a novel method named P2PTracking (Patch-to-Pixel Point Tracking) is implemented. This process begins with the tracking of a square patch surrounding the point marked by the remote doctor using SiameseFC. Following this, feature matching is performed on the tracked patch in the current frame and the square patch in the labelled frame or template frame. The affine transformation is then calculated based on the feature matching results. Lastly, the point tracking result is derived using the computed affine transformation. Experimental results indicate that the proposed system has a transmission speed of 1.99M/s and a transmission latency of 171 ms when transmitting video at a resolution of 1920 × 1080px, while the proposed method can achieve an accuracy of 96.6 % when the pixel error is 4. The code and data are available at https://github.com/hfut66/P2PTracking.git.http://www.sciencedirect.com/science/article/pii/S2950489925000041Surgical telementoringPatch trackingPoint trackingFeature matchingTemplate update mechanism |
| spellingShingle | Yanwei Qu Ling Li Tongtong Li Jieyu Zheng Wentao Tang Xiaojian Li Smart surgical telementoring system with patch-to-pixel point tracking method EngMedicine Surgical telementoring Patch tracking Point tracking Feature matching Template update mechanism |
| title | Smart surgical telementoring system with patch-to-pixel point tracking method |
| title_full | Smart surgical telementoring system with patch-to-pixel point tracking method |
| title_fullStr | Smart surgical telementoring system with patch-to-pixel point tracking method |
| title_full_unstemmed | Smart surgical telementoring system with patch-to-pixel point tracking method |
| title_short | Smart surgical telementoring system with patch-to-pixel point tracking method |
| title_sort | smart surgical telementoring system with patch to pixel point tracking method |
| topic | Surgical telementoring Patch tracking Point tracking Feature matching Template update mechanism |
| url | http://www.sciencedirect.com/science/article/pii/S2950489925000041 |
| work_keys_str_mv | AT yanweiqu smartsurgicaltelementoringsystemwithpatchtopixelpointtrackingmethod AT lingli smartsurgicaltelementoringsystemwithpatchtopixelpointtrackingmethod AT tongtongli smartsurgicaltelementoringsystemwithpatchtopixelpointtrackingmethod AT jieyuzheng smartsurgicaltelementoringsystemwithpatchtopixelpointtrackingmethod AT wentaotang smartsurgicaltelementoringsystemwithpatchtopixelpointtrackingmethod AT xiaojianli smartsurgicaltelementoringsystemwithpatchtopixelpointtrackingmethod |