Knowledge-driven semantic converting method of multimodal models toward a geospatial perspective

In the virtual geographic environment, conducting status analysis on urban structures and similar objects is crucial for enhancing their detailed management level. However, it is challenging to directly convert the same object across various software systems with different modalities (such as spatia...

Full description

Saved in:
Bibliographic Details
Main Authors: Jianbo Lai, Jun Zhu, Pei Dang, Jianlin Wu, Yukun Guo, Xinyu Yang, Na Li
Format: Article
Language:English
Published: Taylor & Francis Group 2025-01-01
Series:Geo-spatial Information Science
Subjects:
Online Access:https://www.tandfonline.com/doi/10.1080/10095020.2025.2454520
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832540800195493888
author Jianbo Lai
Jun Zhu
Pei Dang
Jianlin Wu
Yukun Guo
Xinyu Yang
Na Li
author_facet Jianbo Lai
Jun Zhu
Pei Dang
Jianlin Wu
Yukun Guo
Xinyu Yang
Na Li
author_sort Jianbo Lai
collection DOAJ
description In the virtual geographic environment, conducting status analysis on urban structures and similar objects is crucial for enhancing their detailed management level. However, it is challenging to directly convert the same object across various software systems with different modalities (such as spatial analysis, BIM design, numerical simulation etc.). Therefore, the effective conversion of multi-modal models becomes pivotal. Due to the characteristics of inconsistent spatial description and complex association relationship among multimodal models, resulting in low knowledge reuse rate, poor accuracy of unit mapping, and low efficiency of state sharing in the process of model conversion. Aiming at these problems, this article delves into the knowledge-driven semantic conversion techniques for multi-modal models from a geospatial viewpoint. The mapping relationships between multimodal models in terms of spatial, geometric, and semantic information were first clarified. Subsequently, a structural matching template based on knowledge reuse was established, and a knowledge-guided algorithm for multimodal model transformation was designed. Finally, using a suspension bridge as a case study, a prototype system was developed and experimental analysis was conducted. The experimental results show that the method proposed in this article can accurately convert between BIM models, numerical analysis models, and GIS scene models, with spatial coordinate accuracy controlled within 1 mm and a conversion efficiency increase of more than 10 times. This can effectively enhance the integrated performance of models in applications such as digital geospatial twin scenarios.
format Article
id doaj-art-7473753be3044e5cb4c69ea9e4b5851f
institution Kabale University
issn 1009-5020
1993-5153
language English
publishDate 2025-01-01
publisher Taylor & Francis Group
record_format Article
series Geo-spatial Information Science
spelling doaj-art-7473753be3044e5cb4c69ea9e4b5851f2025-02-04T15:16:31ZengTaylor & Francis GroupGeo-spatial Information Science1009-50201993-51532025-01-0111810.1080/10095020.2025.2454520Knowledge-driven semantic converting method of multimodal models toward a geospatial perspectiveJianbo Lai0Jun Zhu1Pei Dang2Jianlin Wu3Yukun Guo4Xinyu Yang5Na Li6School of Emergency Management, Chengdu University, Chengdu, ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, ChinaIn the virtual geographic environment, conducting status analysis on urban structures and similar objects is crucial for enhancing their detailed management level. However, it is challenging to directly convert the same object across various software systems with different modalities (such as spatial analysis, BIM design, numerical simulation etc.). Therefore, the effective conversion of multi-modal models becomes pivotal. Due to the characteristics of inconsistent spatial description and complex association relationship among multimodal models, resulting in low knowledge reuse rate, poor accuracy of unit mapping, and low efficiency of state sharing in the process of model conversion. Aiming at these problems, this article delves into the knowledge-driven semantic conversion techniques for multi-modal models from a geospatial viewpoint. The mapping relationships between multimodal models in terms of spatial, geometric, and semantic information were first clarified. Subsequently, a structural matching template based on knowledge reuse was established, and a knowledge-guided algorithm for multimodal model transformation was designed. Finally, using a suspension bridge as a case study, a prototype system was developed and experimental analysis was conducted. The experimental results show that the method proposed in this article can accurately convert between BIM models, numerical analysis models, and GIS scene models, with spatial coordinate accuracy controlled within 1 mm and a conversion efficiency increase of more than 10 times. This can effectively enhance the integrated performance of models in applications such as digital geospatial twin scenarios.https://www.tandfonline.com/doi/10.1080/10095020.2025.2454520Virtual geographical environmentmultimodal modelsemantic conversionknowledge-drivenmatching template
spellingShingle Jianbo Lai
Jun Zhu
Pei Dang
Jianlin Wu
Yukun Guo
Xinyu Yang
Na Li
Knowledge-driven semantic converting method of multimodal models toward a geospatial perspective
Geo-spatial Information Science
Virtual geographical environment
multimodal model
semantic conversion
knowledge-driven
matching template
title Knowledge-driven semantic converting method of multimodal models toward a geospatial perspective
title_full Knowledge-driven semantic converting method of multimodal models toward a geospatial perspective
title_fullStr Knowledge-driven semantic converting method of multimodal models toward a geospatial perspective
title_full_unstemmed Knowledge-driven semantic converting method of multimodal models toward a geospatial perspective
title_short Knowledge-driven semantic converting method of multimodal models toward a geospatial perspective
title_sort knowledge driven semantic converting method of multimodal models toward a geospatial perspective
topic Virtual geographical environment
multimodal model
semantic conversion
knowledge-driven
matching template
url https://www.tandfonline.com/doi/10.1080/10095020.2025.2454520
work_keys_str_mv AT jianbolai knowledgedrivensemanticconvertingmethodofmultimodalmodelstowardageospatialperspective
AT junzhu knowledgedrivensemanticconvertingmethodofmultimodalmodelstowardageospatialperspective
AT peidang knowledgedrivensemanticconvertingmethodofmultimodalmodelstowardageospatialperspective
AT jianlinwu knowledgedrivensemanticconvertingmethodofmultimodalmodelstowardageospatialperspective
AT yukunguo knowledgedrivensemanticconvertingmethodofmultimodalmodelstowardageospatialperspective
AT xinyuyang knowledgedrivensemanticconvertingmethodofmultimodalmodelstowardageospatialperspective
AT nali knowledgedrivensemanticconvertingmethodofmultimodalmodelstowardageospatialperspective