Force Measurement Technology of Vision‐Based Tactile Sensor

Marker‐type vision‐based tactile sensors (VTS) realize force sensing by calibrating marker vector information. The tactile visualization can provide high‐precision and multimodal force information to promote robotic dexterous manipulation development. Considering VTS's contribution to force mea...

Full description

Saved in:
Bibliographic Details
Main Authors: Bin Fang, Jie Zhao, Nailong Liu, Yuhao Sun, Shixin Zhang, Fuchun Sun, Jianhua Shan, Yiyong Yang
Format: Article
Language:English
Published: Wiley 2025-01-01
Series:Advanced Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1002/aisy.202400290
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832592545824112640
author Bin Fang
Jie Zhao
Nailong Liu
Yuhao Sun
Shixin Zhang
Fuchun Sun
Jianhua Shan
Yiyong Yang
author_facet Bin Fang
Jie Zhao
Nailong Liu
Yuhao Sun
Shixin Zhang
Fuchun Sun
Jianhua Shan
Yiyong Yang
author_sort Bin Fang
collection DOAJ
description Marker‐type vision‐based tactile sensors (VTS) realize force sensing by calibrating marker vector information. The tactile visualization can provide high‐precision and multimodal force information to promote robotic dexterous manipulation development. Considering VTS's contribution to force measurement, this article reviews the advanced force measurement technologies of VTSs. First, the working principle of marker‐type VTSs is introduced, including single‐layer markers, double‐layer markers, color coding, and optical flow. Then, the relationship between the marker type and the category of force measurement is discussed in detail. On this basis, the process of marker feature extraction is summarized, including image processing and marker‐matching technologies. According to the learning approach, force measurement methods are classified into physical and deep learning models. Further, branches of each method are analyzed in terms of input types. Combined with measuring range and precision, the correlation of sensor design, materials, and recognition methods to force measurement performance is further discussed. Finally, the difficulties and challenges are analyzed, and future developments are proposed. This review aims to deepen understanding of the research progress and applications and provide a reference for the research community to promote technology generations in related fields.
format Article
id doaj-art-029f6a6eb8e244d5b054650e4f3c3a6a
institution Kabale University
issn 2640-4567
language English
publishDate 2025-01-01
publisher Wiley
record_format Article
series Advanced Intelligent Systems
spelling doaj-art-029f6a6eb8e244d5b054650e4f3c3a6a2025-01-21T07:26:27ZengWileyAdvanced Intelligent Systems2640-45672025-01-0171n/an/a10.1002/aisy.202400290Force Measurement Technology of Vision‐Based Tactile SensorBin Fang0Jie Zhao1Nailong Liu2Yuhao Sun3Shixin Zhang4Fuchun Sun5Jianhua Shan6Yiyong Yang7School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing 100876 ChinaAnhui Province Key Laboratory of Special Heavy Load Robot Anhui University of Technology Ma'anshan 243002 ChinaNational Key Laboratory of Space Intelligent Control Beijing Institute of Control Engineering Beijing 100094 ChinaSchool of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing 100876 ChinaSchool of Engineering and Technology China University of Geosciences (Beijing) Beijing 100083 ChinaDepartment of Computer Science and Technology Tsinghua University Beijing 100084 ChinaAnhui Province Key Laboratory of Special Heavy Load Robot Anhui University of Technology Ma'anshan 243002 ChinaSchool of Engineering and Technology China University of Geosciences (Beijing) Beijing 100083 ChinaMarker‐type vision‐based tactile sensors (VTS) realize force sensing by calibrating marker vector information. The tactile visualization can provide high‐precision and multimodal force information to promote robotic dexterous manipulation development. Considering VTS's contribution to force measurement, this article reviews the advanced force measurement technologies of VTSs. First, the working principle of marker‐type VTSs is introduced, including single‐layer markers, double‐layer markers, color coding, and optical flow. Then, the relationship between the marker type and the category of force measurement is discussed in detail. On this basis, the process of marker feature extraction is summarized, including image processing and marker‐matching technologies. According to the learning approach, force measurement methods are classified into physical and deep learning models. Further, branches of each method are analyzed in terms of input types. Combined with measuring range and precision, the correlation of sensor design, materials, and recognition methods to force measurement performance is further discussed. Finally, the difficulties and challenges are analyzed, and future developments are proposed. This review aims to deepen understanding of the research progress and applications and provide a reference for the research community to promote technology generations in related fields.https://doi.org/10.1002/aisy.202400290dexterous manipulationsforce measurementsmarker‐type vision‐based tactile sensors
spellingShingle Bin Fang
Jie Zhao
Nailong Liu
Yuhao Sun
Shixin Zhang
Fuchun Sun
Jianhua Shan
Yiyong Yang
Force Measurement Technology of Vision‐Based Tactile Sensor
Advanced Intelligent Systems
dexterous manipulations
force measurements
marker‐type vision‐based tactile sensors
title Force Measurement Technology of Vision‐Based Tactile Sensor
title_full Force Measurement Technology of Vision‐Based Tactile Sensor
title_fullStr Force Measurement Technology of Vision‐Based Tactile Sensor
title_full_unstemmed Force Measurement Technology of Vision‐Based Tactile Sensor
title_short Force Measurement Technology of Vision‐Based Tactile Sensor
title_sort force measurement technology of vision based tactile sensor
topic dexterous manipulations
force measurements
marker‐type vision‐based tactile sensors
url https://doi.org/10.1002/aisy.202400290
work_keys_str_mv AT binfang forcemeasurementtechnologyofvisionbasedtactilesensor
AT jiezhao forcemeasurementtechnologyofvisionbasedtactilesensor
AT nailongliu forcemeasurementtechnologyofvisionbasedtactilesensor
AT yuhaosun forcemeasurementtechnologyofvisionbasedtactilesensor
AT shixinzhang forcemeasurementtechnologyofvisionbasedtactilesensor
AT fuchunsun forcemeasurementtechnologyofvisionbasedtactilesensor
AT jianhuashan forcemeasurementtechnologyofvisionbasedtactilesensor
AT yiyongyang forcemeasurementtechnologyofvisionbasedtactilesensor