Multi robots interactive control using mixed reality. Issue 23 (2nd December 2021)

• Record Type: Journal Article
• Authors: Ostanin, M.; Yagfarov, R.; Devitt, D.; Akhmetzyanov, A.; Klimchik, A.
• Is Part Of: International journal of production research. Volume 59:Issue 23(2021)
• Page Start: 7126
• Page End: 7138
• Publication Date: 2021-12-02
• Subjects: Human–robot interaction -- mixed reality -- augmented reality -- robotics -- multi-robot systems -- interactive systems; Factory management -- Periodicals; 658.57
• DOI: 10.1080/00207543.2020.1834640
• Languages: English
• ISSNs: 0020-7543

Abstract

Abstract : The paper presents a framework for interactive control of multi robots using mixed reality interfaces. The proposed approach can operate with both single and multi-robot systems, including interaction with industrial manipulators, mobile robots, and unmanned aerial vehicles (UAV). The human–robot interface allows both interactive and physical interaction with the robot. Particular attention is paid to a visualisation of the robots' intent during control. The presented framework has Robotic Operation System (ROS) as a core that can be connected to any robot and mixed reality interface. This allows us to make framework scalable and connect several different mixed reality devices and multiple heterogeneous robots. In the implementation part we connected our framework with Microsoft HoloLens, collaborative robot KUKA IIWA, mobile platform Plato, UAV designed on the basis of dji f450. The proposed framework was tested experimentally with real experimental setups mentioned above. The results showed the capabilities of the mixed reality system for interactive control of different robots' type.