A metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopy

Abstract We present a metaverse laboratory system that integrates mixed reality (MR) technologies with scanning probe microscopy (SPM) for interactive atomic-scale visualization and manipulation. In order to accommodate both the visualization and input of SPM data in a virtual environment and the ph...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhuo Diao, Hayato Yamashita, Masayuki Abe
Format: Article
Language:English
Published: Nature Portfolio 2025-05-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-025-01578-y
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract We present a metaverse laboratory system that integrates mixed reality (MR) technologies with scanning probe microscopy (SPM) for interactive atomic-scale visualization and manipulation. In order to accommodate both the visualization and input of SPM data in a virtual environment and the physical interaction with SPM-related equipment in the laboratory, the system incorporates a virtual reality (VR) and augmented reality (AR) framework to enable seamless switching between these two environments. Utilizing the pose-tracking capabilities in AR, users can intuitively interact with virtual interface elements and three-dimensional objects through physical hand gesture input to control SPM parameters and probe positioning. The system provides real-time visualization of scanned surfaces at the atomic scale in the virtual environment, enabling immediate feedback during experiments. To demonstrate the system’s capabilities, we performed atomic manipulation experiments using hand gestures for lateral probe positioning, showing how MR-enhanced SPM can simplify nanoscale operations and improve experimental efficiency. Our integrated MR–SPM system allows users to conduct experiments via the metaverse platform while enhancing the human-instrument interaction experience. It extends the practical utility required for both real-time physical and virtual environment SPM operations in the laboratory, making nanoscale research more accessible and intuitive.
ISSN:2045-2322