A pipeline for multiparty volumetric video conferencing: Transmission of point clouds over low latency DASH

Jack Jansen, Shishir Subramanyam, Romain Bouqueau, Gianluca Cernigliaro, Marc Martos Cabré, Fernando Pérez, Pablo Cesar

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

18 Citations (Scopus)
241 Downloads (Pure)

Abstract

The advent of affordable 3D capture and display hardware is making volumetric videoconferencing feasible. This technology increases the immersion of the participants, breaking the flat restriction of 2D screens, by allowing them to collaborate and interact in shared virtual reality spaces. In this paper we introduce the design and development of an architecture intended for volumetric videoconferencing that provides a highly realistic 3D representation of the participants, based on pointclouds. A pointcloud representation is suitable for real-time applications like video conferencing, due to its low-complexity and because it does not need a time consuming reconstruction process. As transport protocol we selected low latency DASH, due to its popularity and client-based adaptation mechanisms for tiling. This paper presents the architectural design, details the implementation, and provides some referential results. The demo will showcase the system in action, enabling volumetric videoconferencing using pointclouds.

Original languageEnglish
Title of host publicationMMSys 2020 - Proceedings of the 2020 Multimedia Systems Conference
PublisherAssociation for Computing Machinery (ACM)
Pages341-344
Number of pages4
ISBN (Electronic)9781450368452
DOIs
Publication statusPublished - 27 May 2020
Event11th ACM Multimedia Systems Online Conference, MMSys 2020 - Istanbul, Turkey
Duration: 8 Jun 202011 Jun 2020

Conference

Conference11th ACM Multimedia Systems Online Conference, MMSys 2020
Country/TerritoryTurkey
CityIstanbul
Period8/06/2011/06/20

Keywords

  • low latency dash
  • pointclouds
  • social VR

Fingerprint

Dive into the research topics of 'A pipeline for multiparty volumetric video conferencing: Transmission of point clouds over low latency DASH'. Together they form a unique fingerprint.

Cite this