|
TECHNICAL REPORT
Universal Mobile Telecommunications System (UMTS);
LTE;
Virtual Reality (VR) media services over 3GPP
(3GPP TR 26.918 version 15.2.0 Release 15)
---------------------- Page: 1 ----------------------
3GPP TR 26.918 version 15.2.0 Release 15 1 ETSI TR 126 918 V15.2.0 (2018-07)
Reference
RTR/TSGS-0426918vf20
Keywords
LTE,UMTS
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88
Important notice
The present document can be downloaded from:
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the
print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
If you find errors in the present document, please send your comment to one of the following services:
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying
and microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.
© ETSI 2018.
All rights reserved.
TM TM TM
DECT , PLUGTESTS , UMTS and the ETSI logo are trademarks of ETSI registered for the benefit of its Members.
TM TM
3GPP and LTE are trademarks of ETSI registered for the benefit of its Members and
of the 3GPP Organizational Partners.
oneM2M logo is protected for the benefit of its Members.
GSM and the GSM logo are trademarks registered and owned by the GSM Association.
ETSI
---------------------- Page: 2 ----------------------
3GPP TR 26.918 version 15.2.0 Release 15 2 ETSI TR 126 918 V15.2.0 (2018-07)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (https://ipr.etsi.org/).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
Foreword
This Technical Report (TR) has been produced by ETSI 3rd Generation Partnership Project (3GPP).
The present document may refer to technical specifications or reports using their 3GPP identities, UMTS identities or
GSM identities. These should be interpreted as being references to the corresponding ETSI deliverables.
The cross reference between GSM, UMTS, 3GPP and ETSI identities can be found under
.
Modal verbs terminology
In the present document "should", "should not", "may", "need not", "will", "will not", "can" and "cannot" are to be
interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.
ETSI
---------------------- Page: 3 ----------------------
3GPP TR 26.918 version 15.2.0 Release 15 3 ETSI TR 126 918 V15.2.0 (2018-07)
Contents
Intellectual Property Rights . 2
Foreword . 2
Modal verbs terminology . 2
Foreword . 8
Introduction . 8
1 Scope . 9
2 References . 9
3 Definitions and abbreviations . 12
3.1 Definitions . 12
3.2 Abbreviations . 12
4 Introduction to Virtual Reality . 13
4.1 Definition . 13
4.1.1 Virtual reality . 13
4.1.2 Augmented reality . 13
4.1.3 Mixed reality . 13
4.2 Video systems . 14
4.2.1 Introduction. 14
4.2.2 Field of view . 14
4.2.2.1 Definition . 14
4.2.2.2 Horizontal FOV . 14
4.2.2.3 Vertical FOV . 15
4.2.3 Lenses for a wider FOV . 15
4.2.4 Optical aberrations . 16
4.2.4.1 Introduction . 16
4.2.4.2 Lens distortion . 16
4.2.4.3 Chromatic aberration . 17
4.2.5 VR Video systems . 17
4.2.5.1 Introduction . 17
4.2.5.2 Capture . 18
4.2.5.3 Sphere stitching . 19
4.2.5.4 Projection . 20
4.2.5.5 Region-wise mapping (packing) . 21
4.2.5.6 Encoding & Decoding . 21
4.2.5.6.1 Introduction . 21
4.2.5.6.2 Single stream approach . 22
4.2.5.6.3 Multi-stream approach . 22
4.2.5.6.4 Tiled stream approach . 22
4.2.5.7 File/DASH encapsulatio n/dec apsulatio n . 23
4.2.5.8 Delivery . 23
4.2.5.9 Rendering . 23
4.3 Audio systems . 24
4.3.1 Introduction. 24
4.3.2 Audio capture system. 25
4.3.2.1 Introduction . 25
4.3.2.2 Audio capture system for scene-based audio representation . 25
4.3.2.3 Audio capture system for channel-based audio representation . 26
4.3.2.4 Audio capture system for object-based audio representation . 27
4.3.3 Content production workflow . 27
4.3.3.1 Introduction . 27
4.3.3.2 Content production workflow for Scene-Based Audio . 27
4.3.3.3 Channel-based content production workflow . 28
4.3.3.4 Production and post production for Object-Based audio representation . 28
4.3.3.5 Object metadata and controls for VR . 29
4.3.4 VR audio production formats. 29
ETSI
---------------------- Page: 4 ----------------------
3GPP TR 26.918 version 15.2.0 Release 15 4 ETSI TR 126 918 V15.2.0 (2018-07)
4.3.4.1 Introduction . 29
4.3.4.2 Survey of existing spatial audio formats . 30
4.3.4.3 Observations. 32
4.3.5 Audio rendering system . 33
4.3.5.1 Audio rendering system for Scene-Based Audio . 33
4.3.5.2 Audio Rendering system for Channel-Based Audio . 33
4.3.5.3 Audio Rendering System for Object-Based Audio . 34
4.3.6 Audio rendering system . 34
4.3.7 Audio quality evaluation of a VR delivery system . 34
4.3.7.1 Audio signal flow . 34
4.3.7.2 Factors influencing the QoE . 35
4.3.7.3 Recommended objectives for quality assessment and assurance . 36
4.3.8 Data exchange for audio formats . 36
4.3.8.1 Introduction . 36
4.3.8.2 Data exchange for Scene-Based Audio formats . 36
4.3.9 Analysis of Ambisonics . 37
4.4 Example service architectures . 37
4.4.1 Introduction. 37
4.4.2 Streaming architecture . 37
5 Use cases for Virtual Reality . 38
5.1 General overview . 38
5.1.1 Introduction. 38
5.1.2 Single observation point . 38
5.1.3 Continuously variable observation point . 39
5.1.4 Background to the use cases . 39
5.1.5 Simultaneous diegetic and non-diegetic rendering . 39
5.2 Event broadcast/multicast use cases . 39
5.2.1 Introduction. 39
5.2.2 "Infinite seating" content delivery via multicast . 39
5.2.3 Event multicast to VR receivers . 40
5.3 VR streaming . 40
5.3.1 Use case . 40
5.3.2 Areas of investigation . 41
5.4 Distributing 360 A/V content library in 3GPP . 41
5.4.1 Introduction: content library and target devices. 41
5.4.2 Downloading content . 42
5.4.3 Non-real-time MBMS distribution of VR content . 42
5.4.4 Streaming content . 42
5.5 Live services consumed on HMD . 42
5.5.1 Introduction. 42
5.5.2 Streaming content . 42
5.5.3 MBMS delivery of content . 42
5.5.4 Mixed delivery of content . 42
5.6 Social TV and VR . 43
5.6.1 Base use case . 43
5.6.2 360-degree experience . 43
5.7 Cinematic VR use cases . 43
5.7.1 Introduction. 43
5.7.2 Linear cinematic VR . 43
5.7.3 Interactive cinematic VR . 43
5.8 Learning application use cases . 43
5.8.1 Introduction. 43
5.8.2 Remote class participation . 44
5.9 VR calls use cases . 44
5.9.1 Spherical video based calls . 44
5.9.2 Videoconferencing with 360 video . 44
5.9.3 Gap analysis for VR calls use cases . 44
5.10 User generated VR use cases . 45
5.10.1 User generated 360 video and audio recording . 45
5.10.2 User generated live streaming - "See what I see" . 45
5.11 Virtual world communication. 45
ETSI
---------------------- Page: 5 ----------------------
3GPP TR 26.918 version 15.2.0 Release 15 5 ETSI TR 126 918 V15.2.0 (2018-07)
5.11.1 In-Game Communications . 45
5.11.2 Virtual Meeting Place . 45
5.12 HMD-based legacy content consumption . 46
5.12.1 Introduction. 46
5.12.2 Private TV . 46
5.12.3 Floating mosaic . 46
5.12.4 Enriched TV. 47
5.13 Use cases for Highlight Region(s) in VR video . 47
5.13.1 Initial view point for on-demand content . 47
5.13.2 View point for random tuning in . 48
5.13.3 Director view from artistic intent . 48
5.13.4 Region-of-Interest (RoI)-driven content consumption . 48
6 Audio quality evaluation . 49
6.1 Audio quality evaluation of scene-based formats . 49
6.1.1 Introduction. 49
6.1.2 Report of one ITU-R BS.1534-3 binaural listening test for basic audio quality of encoded scene-
based audio content with non-individualized HRTF and non-equalized headphones . 49
6.1.3 Report of one ITU-R BS.1534-3 binaural listening test for Localization quality of synthetic scene-
based audio content with non-individualized HRTF and non-equalized headphones . 52
6.1.4 Test of the ISO/IEC 23008-3 MPEG-H 3D Audio scene-based coding scheme . 54
6.1.5 Listening test for synthetic scene-based audio content with loudspeaker rendering assessing overall
and localization quality with written audio scene descriptions as reference . 54
6.1.5.1 Introduction . 54
6.1.5.2 Objectives. 54
6.1.5.3 Test methodology . 55
6.1.5.4 Physical test setup . 55
6.1.5.5 Test material . 56
6.1.5.6 Test conditions . 56
6.1.5.7 Listening panel . 57
6.1.5.8 Software . 57
6.1.5.9 Test results . 58
6.1.5.10 Conclusions . 61
6.1.6 Report of one test on encoding First-Order Ambisonics with 3GPP enhanced AAC+ with
loudspeakers and with non-individualized HRTF and non-equalized headphones . 61
6.1.6.1 Introduction . 61
6.1.6.2 Test Method . 62
6.1.6.3 Processing First-Order Ambisonics for Stereo eAAC+ Encoding . 63
6.1.6.4 Results . 65
6.1.6.5 Conclusions . 67
6.1.7 Listening test for coding of First-Order Ambisonics using the EVS codec with loudspeaker
rendering . 67
6.1.7.1 Introduction . 67
6.1.7.2 Objectives. 67
6.1.7.3 Test methodology . 68
6.1.
...