A digital interface to support intercultural relationship building (SIGGRAPH ASIA 2019).
Come to the Table! employs an extended reality interface, centred around a domestic kitchen table, as a first step towards overcoming racial tensions by inviting indigenous Maori, people from migrant backgrounds and all others to join viewers, thereby fostering intercultural relationship building.
This system used two Meta 2 AR headsets with Intel RealSense D415 cameras for volumetric capture. Both devices were synchronized over a network connection. Recorded conversations were played back as volumetric holograms seated across the table, creating intimate face-to-face encounters.
The next iteration of this project is FirstContact-VolumetricPlayback, which refined the volumetric playback pipeline.
This project is part of a series exploring video capture and playback technologies across my PhD research. See the evolution here:
- Come to the Table! Haere mai ki te tēpu! -- Gunn, M., Bai, H., Sasikumar, P. SIGGRAPH Asia 2019 XR. [DOI]
- First Contact - Take 2: Using XR to Overcome Intercultural Discomfort (racism) -- Gunn, M., Sasikumar, P., Bai, H. ICAT-EGVE 2020. [PDF]
- First Contact - Take 2: Using XR technology as a bridge between Maori, Pakeha and people from other cultures in Aotearoa, New Zealand -- Gunn, M., Billinghurst, M., Bai, H., Sasikumar, P. Virtual Creativity 11(1), 2021.
- Wearable RemoteFusion: A Mixed Reality Remote Collaboration System with Local Eye Gaze and Remote Hand Gesture Sharing -- Sasikumar, P., Gao, L., Bai, H., Billinghurst, M. ISMAR 2019 Adjunct. [DOI]
This repository is an archive of a Unity XR project presented at SIGGRAPH ASIA 2019 (Brisbane, Australia). Preserved for reference and future recreation on modern hardware.
- Two AR headsets (originally Meta 2)
- Two Intel RealSense 400 series cameras (D415)
- OSC triggers for real-time syncing between computers
- Unity 2019.1.1f1 (should be backwards compatible)
- Main scene:
Combined - Spawn Points: 2 player spawn points and 1 third person viewer
- Networking: Photon (NetworkManagerPhoton)
- Controller tracking: NoloManager
- Volumetric playback via Depthkit and point cloud stitching
Built at the Empathic Computing Lab, University of Auckland.
- OSCore by stella3d
- Smrvfx by Keijiro
- Depthkit by Scatter
MIT