A metaverse laboratory setup for interactive atom visualization and manipulation with scanning probe microscopy

We present a metaverse laboratory system that integrates mixed reality (MR) technologies with scanning probe microscopy (SPM) for interactive atomic-scale visualization and manipulation. In order to accommodate both the visualization and input of SPM data in a virtual environment and the physical interaction with SPM-related equipment in the laboratory, the system incorporates a virtual reality (VR) and augmented reality (AR) framework to enable seamless switching between these two environments. Utilizing the pose-tracking capabilities in AR, users can intuitively interact with virtual interface elements and three-dimensional objects through physical hand gesture input to control SPM parameters and probe positioning. The system provides real-time visualization of scanned surfaces at the atomic scale in the virtual environment, enabling immediate feedback during experiments. To demonstrate the system’s capabilities, we performed atomic manipulation experiments using hand gestures for lateral probe positioning, showing how MR-enhanced SPM can simplify nanoscale operations and improve experimental efficiency. Our integrated MR-SPM system allows users to conduct experiments via the metaverse platform while enhancing the human-instrument interaction experience. It extends the practical utility required for both real-time physical and virtual environment SPM operations in the laboratory, making nanoscale research more accessible and intuitive.