Speaker
Description
Our paper deals with designing and implementing methods for interactive visualization of dynamic spatial data using augmented reality (AR/XR). The data include the work zones of the robots and other information about the environment, e.g. lidar ranges and physical fields are also planned. Visualization takes place using AR headsets Microsoft HoloLens 2. These headsets are equipped with our in-house software modules that allow users to view data and manipulate objects in real-time. The data can of course be both measured and calculated dynamically.
As part of our development, we create suitable tools for spatial data visualization in AR/XR, including their integration and extension for the industry. In this area, the design and implementation of methods for effective data transfer between AR (respectively headset) and real devices. It is necessary to consider different formats, sources, and data characteristics (size, resolution, time dependence, uncertainty...) Applications also include voice and gesture control.
An important part of the development is also the design of suitable ergonomics applications in AR, where standardized solutions and standards have not yet been established, as is the case with the development of common 2D applications.
Bibliography
[1] Morales Méndez, G.; del Cerro Velázquez, F. Impact of Augmented Reality on Assistance and Training in Industry 4.0: Qualitative Evaluation and Meta-Analysis. Appl. Sci. 2024, 14, 4564.
https://doi.org/10.3390/app14114564
[2] Kunkera, Z.; Željković, I.; Mimica, R.; Ljubenkov, B.; Opetuk, T. Development of Augmented Reality Technology Implementation in a Shipbuilding Project Realization Process. J. Mar. Sci. Eng. 2024, 12, 550. https://doi.org/10.3390/jmse12040550
[3] Torres, W.; Santos, L.; Melo, G.; Oliveira, A.; Nascimento, P.; Carvalho, G.; Neves, T.; Martins, A.; Araújo, Í. A Framework for Real-Time Gestural Recognition and Augmented Reality for Industrial Applications. Sensors 2024, 24, 2407. https://doi.org/10.3390/s24082407
[4] Zaccardi, S.; Frantz, T.; Beckwée, D.; Swinnen, E.; Jansen, B. On-Device Execution of Deep Learning Models on HoloLens2 for Real-Time Augmented Reality Medical Applications. Sensors 2023, 23,
8698. https://doi.org/10.3390/s23218698
[5] Liu, Q.; Huang, S.; Opadere, J.; Han, T. An Edge Network Orchestrator for Mobile Augmented Reality. IEEE INFOCOM 2018 - IEEE Conference on Computer Communications, Honolulu, HI, USA, 2018, pp. 756-764, doi: 10.1109/INFOCOM.2018.8486241.
