| Publikationstyp: | Konferenz: Sonstiges |
| Art der Begutachtung: | Keine Begutachtung |
| Titel: | Real time motion tracking for augmented reality with TOF camera and vulkan rendering |
| Autor/-in: | Wegmann, Marcel |
| et. al: | No |
| Angaben zur Konferenz: | Embedded Computing Conference (ECC), Winterthur, 31. Mai 2022 |
| Erscheinungsdatum: | 31-Mai-2022 |
| Sprache: | Englisch |
| Schlagwörter: | Augmented reality; Time of Flight Camera; TOF; AR; RANSAC; Singular Value Decomposition (SVD); Kalman Filter; Sensor Fusion; Vulkan API |
| Fachgebiet (DDC): | 006: Spezielle Computerverfahren |
| Zusammenfassung: | This presentation describes a new concept for motion tracking in augmented reality systems using new approaches from an actual research project at ZHAW-InES. Motion tracking and the resulting recalculation of the representation of virtual objects is the key function in augmented reality systems. One of the innovations described in this paper is the sensor fusion of a Time of Flight (TOF) camera to spatially capture the environment in conjunction with a standard color camera to compute the 3D representation. The final 3D output is then generated using the open standard Vulkan low-overhead, cross-platform rendering API. Motion processing is based on the angular velocity and translation extraction using the Nvidia CUDA SIFT (Scale invariant feature transform) library. The extracted angular velocity is then fused with IMU (Inertial Motion Unit) data using a Kalman filter for the sensor fusion. The presentation also briefly discusses the hardware architecture, which is based on the NVIDIA Jetson-AGX. As a conclusion, motion tracking using a TOF camera and the Vulkan rendering library speeds up the tracking process, resulting in a real-time and more realistic user experience. |
| Weitere Angaben: | Vortrag in der Themengruppe Hardware und DSP |
| URI: | https://digitalcollection.zhaw.ch/handle/11475/25108 |
| Volltext Version: | Publizierte Version |
| Lizenz (gemäss Verlagsvertrag): | Keine Angabe |
| Departement: | School of Engineering |
| Organisationseinheit: | Institute of Embedded Systems (InES) |
| Enthalten in den Sammlungen: | Publikationen School of Engineering |
Dateien zu dieser Ressource:
Es gibt keine Dateien zu dieser Ressource.
Zur Langanzeige
Wegmann, M. (2022, May 31). Real time motion tracking for augmented reality with TOF camera and vulkan rendering. Embedded Computing Conference (ECC), Winterthur, 31. Mai 2022.
Wegmann, M. (2022) ‘Real time motion tracking for augmented reality with TOF camera and vulkan rendering’, in Embedded Computing Conference (ECC), Winterthur, 31. Mai 2022.
M. Wegmann, “Real time motion tracking for augmented reality with TOF camera and vulkan rendering,” in Embedded Computing Conference (ECC), Winterthur, 31. Mai 2022, May 2022.
WEGMANN, Marcel, 2022. Real time motion tracking for augmented reality with TOF camera and vulkan rendering. In: Embedded Computing Conference (ECC), Winterthur, 31. Mai 2022. Conference presentation. 31 Mai 2022
Wegmann, Marcel. 2022. “Real Time Motion Tracking for Augmented Reality with TOF Camera and Vulkan Rendering.” Conference presentation. In Embedded Computing Conference (ECC), Winterthur, 31. Mai 2022.
Wegmann, Marcel. “Real Time Motion Tracking for Augmented Reality with TOF Camera and Vulkan Rendering.” Embedded Computing Conference (ECC), Winterthur, 31. Mai 2022, 2022.
Alle Ressourcen in diesem Repository sind urheberrechtlich geschützt, soweit nicht anderweitig angezeigt.