Robotic Arm Control by Augmented Reality-assisted Object Detection

Various robotic arm control systems have been proposed to support the daily lives of patients with severe motor impairments; however, existing robotic arm control devices typically require physical input devices, such as joysticks, which are often difficult for patients with motor impairments to use. To overcome these limitations, this paper proposes a new method for controlling a robotic arm using augmented reality and object detection. The system automatically configures the path from the robotic arm to the object, allowing all operations to be performed using only eye tracking. With precise object localization and an intuitive gaze-based interface, the proposed robotic arm control system offers a significant advantage for patients with motor impairments, providing a more accessible and user-friendly alternative to traditional control methods.