Real-time Detection and Tracking for Operating Vehicles in Complex Mining Environments

Aiming at the problems of poor detection effect and low tracking stability of multi-type vehicles in complex mining environment due to the similarity of operating vehicles and background images, this paper proposes a multi-category and multi-target real-time detection and tracking algorithm for oper...

Full description

Saved in:
Bibliographic Details
Main Authors: KANG Gaoqiang, LIN Jun, LIU Shiwang, YUE Wei, XIONG Qunfang, TONG Hao
Format: Article
Language:zho
Published: Editorial Office of Control and Information Technology 2022-10-01
Series:Kongzhi Yu Xinxi Jishu
Subjects:
Online Access:http://ctet.csrzic.com/thesisDetails#10.13889/j.issn.2096-5427.2022.05.300
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Aiming at the problems of poor detection effect and low tracking stability of multi-type vehicles in complex mining environment due to the similarity of operating vehicles and background images, this paper proposes a multi-category and multi-target real-time detection and tracking algorithm for operating vehicles in complex mining environments. The model framework is constructed based on the lightweight backbone network YOLO combined with the multi-scale feature fusion module. The model uses DIoU as loss function, uses <italic>K</italic>-means clustering to regress the size of candidate frame, and learns image features through the lightweight backbone network. On this basis, the features of multi-category work vehicle targets are used as similarity metric, combined with Mahalanobis distance metric and cosine metric that characterize motion information for cascading matching, and IoU matching and Kalman filtering are connected in series to confirm the trajectory and the real-time tracking of multiple work vehicles. Experimental results show that the average vehicle detection accuracy of the algorithm mAP@ 0.5-0.95 is 58.40%, the multi-target tracking accuracy reaches 82.60%, and the image processing time per frame is 26.5 ms, which can effectively perform real-time detection and tracking of working vehicles.
ISSN:2096-5427