Real-time 3D reconstruction for mixed reality telepresence using multiple depth sensors.

In recent years, there has been a great development in real-time three-dimensional (3D) scene reconstruction from depth sensor data, as well as the study of such data in Virtual Reality (VR) and Augmented Reality (AR) contexts. Although it has been extensively investigated and has attracted the atte...

Full description

Saved in:
Bibliographic Details
Main Authors: Ishigaki, Shafina Abd Karim, Ismail, Ajune Wanis
Format: Conference or Workshop Item
Published: 2023
Subjects:
Online Access:http://eprints.utm.my/107758/
http://dx.doi.org/10.1007/978-3-031-25088-0_5
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In recent years, there has been a great development in real-time three-dimensional (3D) scene reconstruction from depth sensor data, as well as the study of such data in Virtual Reality (VR) and Augmented Reality (AR) contexts. Although it has been extensively investigated and has attracted the attention of many researchers, the challenge of real-time 3D reconstruction remains a difficult research task. The majority of current techniques, target real-time 3D reconstruction for the single-view-based system rather than multi-view. In order to provide multi-view 3D reconstruction for Mixed Reality (MR) telepresence, this chapter aims to propose a multiple depth sensor capture using a marching square approach to produce a single full 3D reconstruction surface of a moving user in real-time. The chapter explains the design stage that involves setup from multiple depth sensors, surface reconstruction and merging of 3D reconstruction data for MR Telepresence. The chapter ends with results and a conclusion.