Computer Vision-assisted Wireless Channel Simulation for Millimeter Wave Human Motion Recognition
This study proposes a computer vision-assisted millimeter wave wireless channel simulation method incorporating the scattering characteristics of human motions. The aim is to rapidly and cost-effectively generate a training dataset for wireless human motion recognition, thereby avoiding the laboriou...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
China Science Publishing & Media Ltd. (CSPM)
2025-02-01
|
| Series: | Leida xuebao |
| Subjects: | |
| Online Access: | https://radars.ac.cn/cn/article/doi/10.12000/JR24101 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832591802304036864 |
|---|---|
| author | Zhenyu REN Chenqing JI Chao YU Wanli CHEN Rui WANG |
| author_facet | Zhenyu REN Chenqing JI Chao YU Wanli CHEN Rui WANG |
| author_sort | Zhenyu REN |
| collection | DOAJ |
| description | This study proposes a computer vision-assisted millimeter wave wireless channel simulation method incorporating the scattering characteristics of human motions. The aim is to rapidly and cost-effectively generate a training dataset for wireless human motion recognition, thereby avoiding the laborious and cost-intensive efforts associated with physical measurements. Specifically, the simulation process includes the following steps. First, the human body is modeled as 35 interconnected ellipsoids using a primitive-based model, and motion data of these ellipsoids are extracted from videos of human motion. A simplified ray tracing method is then used to obtain the channel response for each snapshot of the primitive model during the motion process. Finally, Doppler analysis is performed on the channel responses of the snapshots to obtain the Doppler spectrograms. The Doppler spectrograms obtained from the simulation can be used to train deep neural network for real wireless human motion recognition. This study examines the channel simulation and action recognition results for four common human actions (“walking” “running” “falling” and “sitting down”) in the 60 GHz band. Experimental results indicate that the deep neural network trained with the simulated dataset achieves an average recognition accuracy of 73.0% in real-world wireless motion recognition. Furthermore, he recognition accuracy can be increased to 93.75% via unlabeled transfer learning and fine-tuning with a small amount of actual data. |
| format | Article |
| id | doaj-art-dca212c3ff8149c194d48d4c56083860 |
| institution | Kabale University |
| issn | 2095-283X |
| language | English |
| publishDate | 2025-02-01 |
| publisher | China Science Publishing & Media Ltd. (CSPM) |
| record_format | Article |
| series | Leida xuebao |
| spelling | doaj-art-dca212c3ff8149c194d48d4c560838602025-01-22T06:12:25ZengChina Science Publishing & Media Ltd. (CSPM)Leida xuebao2095-283X2025-02-011419010110.12000/JR24101R24101Computer Vision-assisted Wireless Channel Simulation for Millimeter Wave Human Motion RecognitionZhenyu REN0Chenqing JI1Chao YU2Wanli CHEN3Rui WANG4Department of Electronic and Electrical Engineering, Southern University of Science and Technology (SUSTech), Shenzhen 518055, ChinaDepartment of Electronic and Electrical Engineering, Southern University of Science and Technology (SUSTech), Shenzhen 518055, ChinaDepartment of Electronic and Electrical Engineering, Southern University of Science and Technology (SUSTech), Shenzhen 518055, ChinaShenzhen Technology University, Shenzhen 518118, ChinaDepartment of Electronic and Electrical Engineering, Southern University of Science and Technology (SUSTech), Shenzhen 518055, ChinaThis study proposes a computer vision-assisted millimeter wave wireless channel simulation method incorporating the scattering characteristics of human motions. The aim is to rapidly and cost-effectively generate a training dataset for wireless human motion recognition, thereby avoiding the laborious and cost-intensive efforts associated with physical measurements. Specifically, the simulation process includes the following steps. First, the human body is modeled as 35 interconnected ellipsoids using a primitive-based model, and motion data of these ellipsoids are extracted from videos of human motion. A simplified ray tracing method is then used to obtain the channel response for each snapshot of the primitive model during the motion process. Finally, Doppler analysis is performed on the channel responses of the snapshots to obtain the Doppler spectrograms. The Doppler spectrograms obtained from the simulation can be used to train deep neural network for real wireless human motion recognition. This study examines the channel simulation and action recognition results for four common human actions (“walking” “running” “falling” and “sitting down”) in the 60 GHz band. Experimental results indicate that the deep neural network trained with the simulated dataset achieves an average recognition accuracy of 73.0% in real-world wireless motion recognition. Furthermore, he recognition accuracy can be increased to 93.75% via unlabeled transfer learning and fine-tuning with a small amount of actual data.https://radars.ac.cn/cn/article/doi/10.12000/JR24101wireless channel simulationwireless human motion recognitionunlabeled transfer learningmillimeter wavecomputer vision |
| spellingShingle | Zhenyu REN Chenqing JI Chao YU Wanli CHEN Rui WANG Computer Vision-assisted Wireless Channel Simulation for Millimeter Wave Human Motion Recognition Leida xuebao wireless channel simulation wireless human motion recognition unlabeled transfer learning millimeter wave computer vision |
| title | Computer Vision-assisted Wireless Channel Simulation for Millimeter Wave Human Motion Recognition |
| title_full | Computer Vision-assisted Wireless Channel Simulation for Millimeter Wave Human Motion Recognition |
| title_fullStr | Computer Vision-assisted Wireless Channel Simulation for Millimeter Wave Human Motion Recognition |
| title_full_unstemmed | Computer Vision-assisted Wireless Channel Simulation for Millimeter Wave Human Motion Recognition |
| title_short | Computer Vision-assisted Wireless Channel Simulation for Millimeter Wave Human Motion Recognition |
| title_sort | computer vision assisted wireless channel simulation for millimeter wave human motion recognition |
| topic | wireless channel simulation wireless human motion recognition unlabeled transfer learning millimeter wave computer vision |
| url | https://radars.ac.cn/cn/article/doi/10.12000/JR24101 |
| work_keys_str_mv | AT zhenyuren computervisionassistedwirelesschannelsimulationformillimeterwavehumanmotionrecognition AT chenqingji computervisionassistedwirelesschannelsimulationformillimeterwavehumanmotionrecognition AT chaoyu computervisionassistedwirelesschannelsimulationformillimeterwavehumanmotionrecognition AT wanlichen computervisionassistedwirelesschannelsimulationformillimeterwavehumanmotionrecognition AT ruiwang computervisionassistedwirelesschannelsimulationformillimeterwavehumanmotionrecognition |