A computer vision and point cloud-based monitoring approach for automated construction tasks using full-scale robotized mobile cranes

Recent years have witnessed rapid development and contemporary trends in smart construction research owing to advances in machine learning algorithms, modern sensory systems, and robotic technologies. In this paper, a novel economical computer vision (CV) and point cloud-based monitoring framework i...

Full description

Saved in:
Bibliographic Details
Main Authors: Xiao Pan, Tony T. Y. Yang, Ruiwu Liu, Yifei Xiao, Fan Xie
Format: Article
Language:English
Published: Tsinghua University Press 2025-06-01
Series:Journal of Intelligent Construction
Subjects:
Online Access:https://www.sciopen.com/article/10.26599/JIC.2025.9180086
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849714138530447360
author Xiao Pan
Tony T. Y. Yang
Ruiwu Liu
Yifei Xiao
Fan Xie
author_facet Xiao Pan
Tony T. Y. Yang
Ruiwu Liu
Yifei Xiao
Fan Xie
author_sort Xiao Pan
collection DOAJ
description Recent years have witnessed rapid development and contemporary trends in smart construction research owing to advances in machine learning algorithms, modern sensory systems, and robotic technologies. In this paper, a novel economical computer vision (CV) and point cloud-based monitoring framework is proposed to assist in the lifting and relocation of construction sources via mobile cranes on site. The proposed framework incorporates a multicamera approach to achieve multiple goals, such as three-dimensional (3D) vision-based real-time reconstruction, 3D localization of construction resources, and safety monitoring. To demonstrate the effectiveness of the proposed framework, field experiments were conducted on a full-scale mobile crane. The results show that the proposed monitoring system achieves real-time performance, which can successfully recognize construction resources and guide the crane to initialize the lifting position and avoid potential moving workers during motion execution.
format Article
id doaj-art-f5414f24c2d34ff5afc9f6ac4c0e3c46
institution DOAJ
issn 2958-3861
2958-2652
language English
publishDate 2025-06-01
publisher Tsinghua University Press
record_format Article
series Journal of Intelligent Construction
spelling doaj-art-f5414f24c2d34ff5afc9f6ac4c0e3c462025-08-20T03:13:47ZengTsinghua University PressJournal of Intelligent Construction2958-38612958-26522025-06-0132918008610.26599/JIC.2025.9180086A computer vision and point cloud-based monitoring approach for automated construction tasks using full-scale robotized mobile cranesXiao Pan0Tony T. Y. Yang1Ruiwu Liu2Yifei Xiao3Fan Xie4Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong 999077, ChinaDepartment of Civil Engineering, The University of British Columbia, Vancouver V6T 1Z4, CanadaDepartment of Mechanical & Industrial Engineering, University of Toronto, Toronto M55 3G8, CanadaDepartment of Civil Engineering, The University of British Columbia, Vancouver V6T 1Z4, CanadaDepartment of Civil Engineering, The University of British Columbia, Vancouver V6T 1Z4, CanadaRecent years have witnessed rapid development and contemporary trends in smart construction research owing to advances in machine learning algorithms, modern sensory systems, and robotic technologies. In this paper, a novel economical computer vision (CV) and point cloud-based monitoring framework is proposed to assist in the lifting and relocation of construction sources via mobile cranes on site. The proposed framework incorporates a multicamera approach to achieve multiple goals, such as three-dimensional (3D) vision-based real-time reconstruction, 3D localization of construction resources, and safety monitoring. To demonstrate the effectiveness of the proposed framework, field experiments were conducted on a full-scale mobile crane. The results show that the proposed monitoring system achieves real-time performance, which can successfully recognize construction resources and guide the crane to initialize the lifting position and avoid potential moving workers during motion execution.https://www.sciopen.com/article/10.26599/JIC.2025.9180086automated construction computer visionimage processingobject detection and tracking stereo vision3d point clouds
spellingShingle Xiao Pan
Tony T. Y. Yang
Ruiwu Liu
Yifei Xiao
Fan Xie
A computer vision and point cloud-based monitoring approach for automated construction tasks using full-scale robotized mobile cranes
Journal of Intelligent Construction
automated construction computer vision
image processing
object detection and tracking stereo vision
3d point clouds
title A computer vision and point cloud-based monitoring approach for automated construction tasks using full-scale robotized mobile cranes
title_full A computer vision and point cloud-based monitoring approach for automated construction tasks using full-scale robotized mobile cranes
title_fullStr A computer vision and point cloud-based monitoring approach for automated construction tasks using full-scale robotized mobile cranes
title_full_unstemmed A computer vision and point cloud-based monitoring approach for automated construction tasks using full-scale robotized mobile cranes
title_short A computer vision and point cloud-based monitoring approach for automated construction tasks using full-scale robotized mobile cranes
title_sort computer vision and point cloud based monitoring approach for automated construction tasks using full scale robotized mobile cranes
topic automated construction computer vision
image processing
object detection and tracking stereo vision
3d point clouds
url https://www.sciopen.com/article/10.26599/JIC.2025.9180086
work_keys_str_mv AT xiaopan acomputervisionandpointcloudbasedmonitoringapproachforautomatedconstructiontasksusingfullscalerobotizedmobilecranes
AT tonytyyang acomputervisionandpointcloudbasedmonitoringapproachforautomatedconstructiontasksusingfullscalerobotizedmobilecranes
AT ruiwuliu acomputervisionandpointcloudbasedmonitoringapproachforautomatedconstructiontasksusingfullscalerobotizedmobilecranes
AT yifeixiao acomputervisionandpointcloudbasedmonitoringapproachforautomatedconstructiontasksusingfullscalerobotizedmobilecranes
AT fanxie acomputervisionandpointcloudbasedmonitoringapproachforautomatedconstructiontasksusingfullscalerobotizedmobilecranes
AT xiaopan computervisionandpointcloudbasedmonitoringapproachforautomatedconstructiontasksusingfullscalerobotizedmobilecranes
AT tonytyyang computervisionandpointcloudbasedmonitoringapproachforautomatedconstructiontasksusingfullscalerobotizedmobilecranes
AT ruiwuliu computervisionandpointcloudbasedmonitoringapproachforautomatedconstructiontasksusingfullscalerobotizedmobilecranes
AT yifeixiao computervisionandpointcloudbasedmonitoringapproachforautomatedconstructiontasksusingfullscalerobotizedmobilecranes
AT fanxie computervisionandpointcloudbasedmonitoringapproachforautomatedconstructiontasksusingfullscalerobotizedmobilecranes