|
GROUP REPORT
Next Generation Protocols (NGP);
Recommendation for New Transport Technologies
Disclaimer
The present document has been produced and approved by the Next Generation Protocols (NGP) ETSI Industry Specification
Group (ISG) and represents the views of those members who participated in this ISG.
It does not necessarily represent the views of the entire ETSI membership.
---------------------- Page: 1 ----------------------
2 ETSI GR NGP 010 V1.1.1 (2018-09)
Reference
DGR/NGP-0010
Keywords
Next Generation Protocol, QoS, transport
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88
Important notice
The present document can be downloaded from:
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the
print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
If you find errors in the present document, please send your comment to one of the following services:
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying
and microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.
© ETSI 2018.
All rights reserved.
TM TM TM
DECT , PLUGTESTS , UMTS and the ETSI logo are trademarks of ETSI registered for the benefit of its Members.
TM TM
3GPP and LTE are trademarks of ETSI registered for the benefit of its Members and
of the 3GPP Organizational Partners.
oneM2M logo is protected for the benefit of its Members.
GSM and the GSM logo are trademarks registered and owned by the GSM Association.
ETSI
---------------------- Page: 2 ----------------------
3 ETSI GR NGP 010 V1.1.1 (2018-09)
Contents
Intellectual Property Rights . 6
Foreword . 6
Modal verbs terminology . 6
Executive summary . 6
Introduction . 6
1 Scope . 8
2 References . 8
2.1 Normative references . 8
2.2 Informative references . 8
3 Definitions and abbreviations . 10
3.1 Definitions . 10
3.2 Abbreviations . 10
4 Introduction . 12
4.1 IP and Transport Technologies . 12
4.2 TCP Solution Analysis . 12
4.2.1 TCP Overview and Evolution . 12
4.2.2 TCP Solution Variants . 13
4.2.3 TCP Throughput Constraints . 13
4.2.4 TCP Latency Constraints . 14
4.2.5 Summary of TCP Solution . 14
4.3 UDP Solution Analysis . 15
4.4 Other Solution Analysis . 15
4.5 New Transport Technology Overview . 15
4.5.1 Fundaments . 15
4.5.2 Design Guidance . 16
4.5.3 Design Targets . 17
4.5.4 Assumptions . 17
4.5.5 Architecture of Framework . 17
5 Network Control Plane Framework . 18
5.1 Introduction . 18
5.2 Sub-layer in IP for Transport Control. 18
5.3 IP In-band Signaling . 19
5.4 Control Mechanism . 20
5.4.1 Protocol Driven In-band signaling . 20
5.4.2 Closed-loop and Open-loop Control by In-band Signaling . 20
5.4.3 Scope of Solution . 21
5.5 IPv6 Solution . 21
5.5.1 Overview . 21
5.5.2 Control Scenarios for TCP . 21
5.5.3 Details of In-band Signaling for TCP . 22
5.5.3.1 Message Type . 22
5.5.3.2 Basic QoS Setup Scenarios . 23
5.5.3.3 Other Control Scenarios . 26
5.5.4 Key Messages and Parameters in Control Protocol . 26
5.5.4.1 Setup State and Setup State Report messages . 26
5.5.4.2 OAM . 27
5.5.4.3 Forwarding State and Forwarding State Report messages . 28
5.5.4.4 Flow Identifying Methods . 28
5.5.4.5 Hop Number . 29
5.5.4.6 Service ID, Service ID Size and Service ID List. 29
5.5.4.7 QoS State and Life of Time. 29
5.5.4.8 Authentication . 29
ETSI
---------------------- Page: 3 ----------------------
4 ETSI GR NGP 010 V1.1.1 (2018-09)
5.5.5 Security Consideration . 29
5.6 IPv4 Solution . 30
6 Network Data Plane Framework . 31
6.1 Basic Capability Requirement . 31
6.2 Key Messages and Parameters in Data Plane . 32
6.2.1 Forwarding State Message . 32
6.2.2 Forwarding State Report Message . 32
6.3 How a Host sends TCP packet . 33
6.4 Flow Identification in Packet Forwarding . 33
6.5 QoS Forwarding State Detection and Failure Handling . 33
6.6 Security Consideration . 34
7 Host Congestion Control and Traffic Management . 35
7.1 Introduction . 35
7.2 Definition of New IP service . 36
7.3 New Congestion Control . 36
7.3.1 Overview . 36
7.3.2 Congestion and Physical Failure Detection . 37
7.3.3 New Congestion Control Algorithm . 37
8 Other Issues . 39
8.1 Introduction . 39
8.2 User and Application Driven, APIs . 39
8.3 Non-Shortest-Path . 39
8.4 Heterogeneous Network . 39
8.5 Proxy Control . 40
8.6 UDP and Other Protocols . 40
8.7 Business Model . 40
8.8 OAM for Other Scenarios . 41
8.9 Other Types of In-band Signaling . 42
9 Experiment . 42
9.1 Introduction . 42
9.2 High Level Hardware, Packet Forwarding and QoS . 42
9.3 Experiment Results and Analysis . 44
9.3.1 Test Topology and Configuration . 44
9.3.2 Bandwidth Guaranteed Service . 45
9.3.3 Minimum Latency Guaranteed Service . 46
9.3.4 Scalability and Performance Analysis . 47
9.3.4.1 Analysis Basics . 47
9.3.4.2 Port Level Scalability and Performance . 48
9.3.4.3 System Level Scalability and Performance . 48
10 Summary . 48
Annex A: Message Formats . 50
A.1 Setup State Msg . 50
A.2 Bandwidth Msg . 50
A.3 Burst Msg . 51
A.4 Latency Msg . 51
A.5 Authentication Msg . 51
A.6 OAM Msg . 51
A.7 Forwarding State Msg . 52
A.8 Setup State Report Msg . 52
A.9 Forwarding State Report Msg . 52
Annex B: Standardization . 53
ETSI
---------------------- Page: 4 ----------------------
5 ETSI GR NGP 010 V1.1.1 (2018-09)
B.1 IANA Considerations . 53
Annex C: Authors & contributors . 54
Annex D: Change History . 55
History . 56
ETSI
---------------------- Page: 5 ----------------------
6 ETSI GR NGP 010 V1.1.1 (2018-09)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (https://ipr.etsi.org/).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
Foreword
This Group Report (GR) has been produced by ETSI Industry Specification Group (ISG) Next Generation Protocols
(NGP).
Modal verbs terminology
In the present document "should", "should not", "may", "need not", "will", "will not", "can" and "cannot" are to be
interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.
Executive summary
The present document focuses on new transport technology for next generation architectures toward 5G and beyond.
The basic concept is to enhance the best-effort based IP network to QoS capable IP network. The goal is to provide the
QoS for the upper layer protocols. The work aims to examine and propose recommendations to improve and simplify
the network infrastructure to support QoS for different transport protocols. In addition, the present document may
require the development of new protocols and or modification of existing protocols.
Introduction
Recently, more and more new applications for Internet are emerging. These applications have a common requirement to
the Internet that is their required bandwidth is very high and/or latency is very low compared to traditional applications
like most of web browser and video streaming applications.
For example, AR or VR applications may need at least couple of hundred Mbps bandwidth (throughput) and a low
single digit MS latency. Moreover, the difference of mean bit rate and peak bit rate is huge due to the compression
algorithm [i.1].
Some future applications expect that Internet can provide a up bounded latency (minimized latency) service, such as
tactile network [i.2]. To these applications, the latency will determine their user experience or application quality, so it
is critical that the maximum latency for application is bounded within values application has requested.
ETSI
---------------------- Page: 6 ----------------------
7 ETSI GR NGP 010 V1.1.1 (2018-09)
With the technology development in 5G and beyond, the wireless access network is also rising the demand for the
Ultra-Reliable and Low-Latency Communications (URLLC), this also leads to the question if IP transport can provide
such service in Evolved Packet Core (EPC) network. IP is becoming more and more important in EPC when the
Multi-access Edge Computing (MEC) for 5G will require the cloud and data service moving closer to eNodeB.
The present document will brief the current IP transport and QoS technologies, and analyse the limitations to support
above new applications.
A frame work for new transport technology based on QoS enabled IP network will be reported. As an example, detailed
design and experiments for TCP are given.
The frame work also lists other areas, topics and issues that need more study to achieve the complete solution.
ETSI
---------------------- Page: 7 ----------------------
8 ETSI GR NGP 010 V1.1.1 (2018-09)
1 Scope
The present document reports the analysis of current transport technologies for Internet, especially TCP, the limit of
different variants for TCP and other transport protocols, and then proposes a framework for new transport technology
for IP network. TCP is exemplified for the detailed design and prove of concept experiments.
In the design, both control plane and data plane are discussed. It includes the control mechanism, message type, key
message parameters, hardware capability, forwarding state, host congestion control and traffic management.
In the experiments, the POC product and its realization are discussed; test results, scalability and performance are
analysed.
2 References
2.1 Normative references
Normative references are not applicable in the present document.
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] Draft-han-iccrg-arvr-transport-problem-01 (work in progress): "Problem Statement: Transport
Support for Augmented and Virtual Reality Applications", L. Han, and K. Smith, March 2017.
[i.2] Proceedings of European Wireless 2015; 21th European Wireless Conference: "Towards the
Tactile Internet: Decreasing Communication Latency with Network Coding and Software Defined
Networking", J David Szabo, 2015.
NOTE: Available at https://ieeexplore.ieee.org/iel7/7147658/7147659/07147730.pdf.
[i.3] DEC Research Report TR-301: "A Quantitative Measure of Fairness and Discrimination for
Resource Allocation in Shared Computer Systems", R. Jain, 1984.
NOTE: Available at http://www1.cse.wustl.edu/~jain/papers/ftp/fairness.pdf.
[i.4] Andreas Benthin, Stefan Mischke, University of Paderborn: "Bandwidth Allocation of TCP",
2004.
[i.5] IETF RFC 2581: "TCP Congestion Control", M. Allman, V. Paxson and W. Stevens, April 1999.
NOTE: Available at https://www.rfc-editor.org/info/rfc2581.
[i.6] L. Peterson: "TCP Vegas: New Techniques for Congestion Detection and Avoidance - CiteSeer
page on the 1994 SIGCOMM paper", 1994.
[i.7] S. Ha, I. Rhee and L. Xu: "CUBIC: A New TCP-Friendly High-Speed TCP Variant", 2008.
[i.8] Draft-sridharan-tcpm-ctcp-02 (work in progress): "Compound TCP: A New TCP Congestion
Control for High-Speed and Long Distance Networks", M. Sridharan, K. Tan, D. Bansal and
D. Thaler, November 2008.
ETSI
---------------------- Page: 8 ----------------------
9 ETSI GR NGP 010 V1.1.1 (2018-09)
[i.9] Radhika Mittal, Vinh The Lam, Nandita Dukkipati, Emily Blem, Hassan Wassel, Monia Ghobadi,
Amin Vahdat, Yaogong Wang, David Wetherall, David Zats: "TIMELY: RTT-based Congestion
Control for the Datacenter", 2010.
NOTE: Available at http://conferences.sigcomm.org/sigcomm/2015/pdf/papers/p537.pdf.
[i.10] Draft-falk-xcp-spec-03 (work in progress): "Specification for the Explicit Control Protocol
(XCP)", A. Falk, Jul 2007.
[i.11] Nandita Dukkipati, Ph.D. Thesis, Department of Electrical Engineering, Stanford University:
"Rate Control Protocol (RCP): Congestion control to make flows complete quickly", 2007.
NOTE: Available at http://yuba.stanford.edu/~nanditad/thesis-NanditaD.pdf.
[i.12] Draft-ietf-tcpm-dctcp-03 (work in progress): "Datacenter TCP (DCTCP): TCP Congestion Control
for Datacenters", S. Bensley, L. Eggert, D. Thaler, P. Balasubramanian, and G. Judd, November
2016.
[i.13] Draft-ietf-aqm-pie-10 (work in progress): "PIE: A Lightweight Control Scheme To Address the
Bufferbloat Problem", R. Pan, P. Natarajan, F. Baker, and G. White, September 2016.
[i.14] Draft-ietf- aqm-codel-06 (work in progress): "Controlled Delay Active Queue Management", K.
Nichols, V. Jacobson, A. McGregor, and J. Iyengar, December 2016.
[i.15] Draft-ietf-aqm-fq-codel-06 (work in progress): "The FlowQueue-CoDel Packet Scheduler and
Active Queue Management Algorithm", T. Hoeiland-Joergensen, P. McKenney
[email protected], J. Gettys and E. Dumazet, March 2016.
[i.16] Lavanya Jose, Mohammad Alizadeh, George Varghese, Nick McKeown, Sachin Kattie: "High
Speed Networks Need Proactive Congestion Control", 2016.
NOTE: Available at http://web.stanford.edu/~lavanyaj/papers/perc-hotnets15.pdf.
[i.17] Neal Cardwell, Yuchung Cheng, C. Stephen Gunn, Soheil Hassas Yeganeh,Van Jacobson: "BBR
Congestion Control", 2016.
NOTE: Available at https://www.ietf.org/proceedings/97/slides/slides-97-iccrg-bbr-congestion-control-02.pdf.
[i.18] Mo Dong, University of Illinois at Urbana-Champaign, Hebrew University of Jerusalem: "PCC:
Re-architecting Congestion Control for Consistent High Performance", 2014.
NOTE: Available at https://arxiv.org/abs/1409.7092.
[i.19] Jonathan Perry: "Fastpass: A Centralized "Zero-Queue" Datacenter Network", 2014.
NOTE: Available at http://fastpass.mit.edu/Fastpass-SIGCOMM14-Perry.pdf.
[i.20] Matthew Mathis, Pittsburgh Supercomputing Center: "The Macroscopic Behavior of the TCP
Congestion Avoidance Algorithm", 1997.
NOTE: Available at https://cseweb.ucsd.edu/classes/wi01/cse222/papers/mathis-tcpmodel-ccr97.pdf.
[i.21] Wei Bao, The University of British Columbia, Vancouver, Canada, IEEE Globecom 2010
...