NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception

Multi-agent multi-sensor fusion between connected vehicles for cooperative perception has recently been recognized as the best technique for minimizing the occluded zone of individual vehicular perception system and further enhancing the overall safety of autonomous driving system. This technique re...

Full description

Saved in:
Bibliographic Details
Main Authors: Lantao Li, Wenqi Zhang, Xiaoxue Wang, Tao Cui, Chen Sun
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Open Journal of Intelligent Transportation Systems
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10745605/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832590304784416768
author Lantao Li
Wenqi Zhang
Xiaoxue Wang
Tao Cui
Chen Sun
author_facet Lantao Li
Wenqi Zhang
Xiaoxue Wang
Tao Cui
Chen Sun
author_sort Lantao Li
collection DOAJ
description Multi-agent multi-sensor fusion between connected vehicles for cooperative perception has recently been recognized as the best technique for minimizing the occluded zone of individual vehicular perception system and further enhancing the overall safety of autonomous driving system. This technique relies heavily on the reliability and availability of vehicle-to-everything (V2X) communication. In practical cooperative perception application scenarios, the non-line-of-sight (NLOS) issue causes occluded zones for not only the perception system but also V2X direct communication, especially for busy traffic scenarios. Cooperative perception can address the NLOS issue for vehicular perception systems once. However, to ensure effective real-world implementation, we must also solve the NLOS challenge a second time for the communication systems that support cooperative perception, NLOS “dies” twice. To counteract underlying communication issues, we introduce an abstract perception matrix matching method for quick sensor fusion matching procedures and mobility-height hybrid relay determination procedures, proactively improving the efficiency and performance of V2X communication to serve the upper layer application fusion requirements. To demonstrate the effectiveness of our solution, a new simulation framework is designed to consider autonomous driving, cooperative perception and V2X communication in general, paving the way for end-to-end performance evaluation and further solution derivation.
format Article
id doaj-art-0a397ea1094745c280e10f491eb26a43
institution Kabale University
issn 2687-7813
language English
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Open Journal of Intelligent Transportation Systems
spelling doaj-art-0a397ea1094745c280e10f491eb26a432025-01-24T00:02:54ZengIEEEIEEE Open Journal of Intelligent Transportation Systems2687-78132024-01-01577478210.1109/OJITS.2024.349221110745605NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative PerceptionLantao Li0https://orcid.org/0009-0006-2071-7609Wenqi Zhang1https://orcid.org/0000-0002-4482-6715Xiaoxue Wang2https://orcid.org/0009-0006-1920-4355Tao Cui3https://orcid.org/0000-0003-4754-0760Chen Sun4https://orcid.org/0000-0003-0256-091XR&D Center, Sony China Ltd., Beijing, ChinaR&D Center, Sony China Ltd., Beijing, ChinaR&D Center, Sony China Ltd., Beijing, ChinaR&D Center, Sony China Ltd., Beijing, ChinaR&D Center, Sony China Ltd., Beijing, ChinaMulti-agent multi-sensor fusion between connected vehicles for cooperative perception has recently been recognized as the best technique for minimizing the occluded zone of individual vehicular perception system and further enhancing the overall safety of autonomous driving system. This technique relies heavily on the reliability and availability of vehicle-to-everything (V2X) communication. In practical cooperative perception application scenarios, the non-line-of-sight (NLOS) issue causes occluded zones for not only the perception system but also V2X direct communication, especially for busy traffic scenarios. Cooperative perception can address the NLOS issue for vehicular perception systems once. However, to ensure effective real-world implementation, we must also solve the NLOS challenge a second time for the communication systems that support cooperative perception, NLOS “dies” twice. To counteract underlying communication issues, we introduce an abstract perception matrix matching method for quick sensor fusion matching procedures and mobility-height hybrid relay determination procedures, proactively improving the efficiency and performance of V2X communication to serve the upper layer application fusion requirements. To demonstrate the effectiveness of our solution, a new simulation framework is designed to consider autonomous driving, cooperative perception and V2X communication in general, paving the way for end-to-end performance evaluation and further solution derivation.https://ieeexplore.ieee.org/document/10745605/V2Xcooperative perceptionend-to-end autonomous driving
spellingShingle Lantao Li
Wenqi Zhang
Xiaoxue Wang
Tao Cui
Chen Sun
NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception
IEEE Open Journal of Intelligent Transportation Systems
V2X
cooperative perception
end-to-end autonomous driving
title NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception
title_full NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception
title_fullStr NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception
title_full_unstemmed NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception
title_short NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception
title_sort nlos dies twice challenges and solutions of v2x for cooperative perception
topic V2X
cooperative perception
end-to-end autonomous driving
url https://ieeexplore.ieee.org/document/10745605/
work_keys_str_mv AT lantaoli nlosdiestwicechallengesandsolutionsofv2xforcooperativeperception
AT wenqizhang nlosdiestwicechallengesandsolutionsofv2xforcooperativeperception
AT xiaoxuewang nlosdiestwicechallengesandsolutionsofv2xforcooperativeperception
AT taocui nlosdiestwicechallengesandsolutionsofv2xforcooperativeperception
AT chensun nlosdiestwicechallengesandsolutionsofv2xforcooperativeperception