A Modular Approach for 3D Reconstruction with Point Cloud Overlay

Schieber H, Schmid F, Hassan Mu, Zollmann S, Roth D (2023)

Publication Language: English

Publication Type: Conference contribution

Publication year: 2023

Publisher: Institute of Electrical and Electronics Engineers Inc.

Pages Range: 609-610

Conference Proceedings Title: 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)

Event location: Sydney, NSW AU

ISBN: 979-8-3503-0582-1

DOI: 10.1109/ISMAR-Adjunct60411.2023.00129

Abstract

Integrating the real-world through the power of 3D reconstruction plays an essential role in extended reality teleconsultation. Video streams and voxel-based representations are common techniques for teleconsultation visualization. However, video streaming applications miss 3D content information, and voxel-based representation can only provide visual details with increasing computational costs. To enhance the classical voxel-based representation and address the timeliness of voxels, we present a modular approach which provides a point cloud overlay to highlight the latest update in the current camera frustum. Our approach applies state-of-the-art algorithms and custom packages within ROS to enable 3D reconstruction with dynamic cameras. We present a modular approach allowing the flexible exchange of the individual part, i.e. the camera or SLAM algorithm. This work presents results from a pilot study involving five participants to gain an impression of what kind of visualization type would be preferred and whether the point cloud overlay would assist the user in recognizing changes in the surroundings. The point cloud overlay enabled the participants to perceive more changes. The pilot study revealed that 60% of the participants showed a preference for the point cloud overlay over the pure mesh representation.

Authors with CRIS profile

Hannah Schieber Juniorprofessur für Human-Centered Computing and Extended Reality

Involved external institutions

University of Otago NZ New Zealand (NZ) Technische Universität München (TUM) DE Germany (DE)

How to cite

APA:

Schieber, H., Schmid, F., Hassan, M.u., Zollmann, S., & Roth, D. (2023). A Modular Approach for 3D Reconstruction with Point Cloud Overlay. In Gerd Bruder, Anne-Helene Olivier, Andrew Cunningham, Evan Yifan Peng, Jens Grubert, Ian Williams (Eds.), 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 609-610). Sydney, NSW, AU: Institute of Electrical and Electronics Engineers Inc..

MLA:

Schieber, Hannah, et al. "A Modular Approach for 3D Reconstruction with Point Cloud Overlay." Proceedings of the 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023, Sydney, NSW Ed. Gerd Bruder, Anne-Helene Olivier, Andrew Cunningham, Evan Yifan Peng, Jens Grubert, Ian Williams, Institute of Electrical and Electronics Engineers Inc., 2023. 609-610.

BibTeX: Download