Publications / 2024 Proceedings of the 41st ISARC, Lille, France
This paper proposes a 3D digital-twin system for remote-control operation in construction. Prevalent remote operation using multiple cameras cannot eliminate blind spots completely due to the limitation of the number of installable cameras. Thus, to ensure various remote operations can be performed safely, the 3D digital-twin system applying is developed. This system can help remote operators to recognize the location and behavior of remote-control machines in virtual space simulating a work site. Experiments using a crawler robot with a manipulator verify that remote operators can grip an object with the gripper of the manipulator while avoiding collision between the robot and the robots surrounding equipment. Furthermore, by using the system, remote operators can complement the field of view which camera images alone could not confirm. To apply the system in various work sites, the following research elements should be examined and verified. The first is to develop the collision-avoidance control with surrounding equipment for manipulators. The second is to improve the accuracy of self-localization and keep robots localized using 3D LiDAR. The third is to reflect the real behavior of objects in virtual space by using sensors such as LiDAR and stereo cameras.