Region sampling NeRF-SLAM based on Kolmogorov-Arnold network.
Currently, NeRF-based SLAM is rapidly developing in reconstructing and bitwise estimating indoor scenes. Compared with traditional SLAM, the advantage of the NeRF-based approach is that the error returns to the pixel itself, the optimization process is WYSIWYG, and it can also be differentiated for...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2025-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0325024 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850162912805519360 |
|---|---|
| author | Zhanrong Li Jiajie Han Chao Jiang Haosheng Su |
| author_facet | Zhanrong Li Jiajie Han Chao Jiang Haosheng Su |
| author_sort | Zhanrong Li |
| collection | DOAJ |
| description | Currently, NeRF-based SLAM is rapidly developing in reconstructing and bitwise estimating indoor scenes. Compared with traditional SLAM, the advantage of the NeRF-based approach is that the error returns to the pixel itself, the optimization process is WYSIWYG, and it can also be differentiated for map representation. Still, it is limited by its MLP-based implicit representation to scale to larger and more complex environments. Inspired by the quadtree in ORB-SLAM2 and the recently proposed Kolmogorov-Arnold network, our approach replaces the MLP with a KAN network based on Gaussian functions, combines quadtree-based regional pixel sampling and random sampling, delineates the scene by voxels, and supports dynamic scaling to realize a high-fidelity reconstruction of large scenes for a SLAM system. Exposure compensation and VIT loss are also introduced to alleviate the necessity of NeRF on dense coverage, which significantly improves the ability to reconstruct sparse outdoor view environments stable. Experiments on three different types of datasets show that our approach reduces the trajectory error accuracy of indoor datasets from centimeter-level to millimeter-level compared to existing NeRF-based SLAM and achieves stable reconstruction in complex outdoor environments, considering the performance while ensuring efficiency. |
| format | Article |
| id | doaj-art-03c8085eb23f469ebd3a1fcf73d2e119 |
| institution | OA Journals |
| issn | 1932-6203 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-03c8085eb23f469ebd3a1fcf73d2e1192025-08-20T02:22:26ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01205e032502410.1371/journal.pone.0325024Region sampling NeRF-SLAM based on Kolmogorov-Arnold network.Zhanrong LiJiajie HanChao JiangHaosheng SuCurrently, NeRF-based SLAM is rapidly developing in reconstructing and bitwise estimating indoor scenes. Compared with traditional SLAM, the advantage of the NeRF-based approach is that the error returns to the pixel itself, the optimization process is WYSIWYG, and it can also be differentiated for map representation. Still, it is limited by its MLP-based implicit representation to scale to larger and more complex environments. Inspired by the quadtree in ORB-SLAM2 and the recently proposed Kolmogorov-Arnold network, our approach replaces the MLP with a KAN network based on Gaussian functions, combines quadtree-based regional pixel sampling and random sampling, delineates the scene by voxels, and supports dynamic scaling to realize a high-fidelity reconstruction of large scenes for a SLAM system. Exposure compensation and VIT loss are also introduced to alleviate the necessity of NeRF on dense coverage, which significantly improves the ability to reconstruct sparse outdoor view environments stable. Experiments on three different types of datasets show that our approach reduces the trajectory error accuracy of indoor datasets from centimeter-level to millimeter-level compared to existing NeRF-based SLAM and achieves stable reconstruction in complex outdoor environments, considering the performance while ensuring efficiency.https://doi.org/10.1371/journal.pone.0325024 |
| spellingShingle | Zhanrong Li Jiajie Han Chao Jiang Haosheng Su Region sampling NeRF-SLAM based on Kolmogorov-Arnold network. PLoS ONE |
| title | Region sampling NeRF-SLAM based on Kolmogorov-Arnold network. |
| title_full | Region sampling NeRF-SLAM based on Kolmogorov-Arnold network. |
| title_fullStr | Region sampling NeRF-SLAM based on Kolmogorov-Arnold network. |
| title_full_unstemmed | Region sampling NeRF-SLAM based on Kolmogorov-Arnold network. |
| title_short | Region sampling NeRF-SLAM based on Kolmogorov-Arnold network. |
| title_sort | region sampling nerf slam based on kolmogorov arnold network |
| url | https://doi.org/10.1371/journal.pone.0325024 |
| work_keys_str_mv | AT zhanrongli regionsamplingnerfslambasedonkolmogorovarnoldnetwork AT jiajiehan regionsamplingnerfslambasedonkolmogorovarnoldnetwork AT chaojiang regionsamplingnerfslambasedonkolmogorovarnoldnetwork AT haoshengsu regionsamplingnerfslambasedonkolmogorovarnoldnetwork |