ISBN: 978-981-14-4787-7 DOI: 10.18178/wcse.2020.06.027
Augmented Reality Assembly Guidance Method Based on Situation Awareness
Abstract—In order to fulfill the maintenance and support task of adaptive Augmented Reality (AR) in complex situations such as environmental changes and product mobility in industrial scenarios, an augmented reality assembly guidance method based on situation awareness is proposed. Firstly, the digital twins corresponding to the physical model are constructed based on the digital twin technology to map the data and information of the entity in real-time. Secondly, the AR equipment is reconstructed to have the ability of deep environmental awareness in order to achieve accurate three-dimensional registration. Finally, situation awareness is realized by multi-sensor fusion, and the information guide is enhanced by fusion for the change of external environment and equipment status. The experimental results show that the augmented reality assembly guidance system based on the concept of digital twin can effectively perceive the external abnormal environment changes and the position and posture of components. According to the corresponding situation, adaptive trigger augmented reality information push, the real-time frame rate in the process of augmented reality guidance can reach 60 FPS
Index Terms—multi-sensor fusion, digital twins, augmented reality assembly induction, situational awareness
Xincan Zhao, Yupeng Sun
School of Information Engineering, Zhengzhou University, CHINA
Cite: Xincan Zhao, Yupeng Sun , " Augmented Reality Assembly Guidance Method Based on Situation Awareness " Proceedings of 2020 the 10th International Workshop on Computer Science and Engineering (WCSE 2020), pp. 165-173, Shanghai, China, 19-21 June, 2020.