T-REC-G.1028-Multimedia Quality of Service and Performance - Generic and User-Related Aspects
T-REC-G.1028-Multimedia Quality of Service and Performance - Generic and User-Related Aspects
T-REC-G.1028-Multimedia Quality of Service and Performance - Generic and User-Related Aspects
ITU-T G.1028
TELECOMMUNICATION (04/2016)
STANDARDIZATION SECTOR
OF ITU
Summary
Recommendation ITU-T G.1028 provides guidelines concerning the key aspects impacting end-to-end
performance of managed voice applications over LTE networks and how they can be properly assessed
using current elements of knowledge.
Some typical end-to-end scenarios are described, involving cases with LTE access at both sides of the
communication, or with a different access technology at one side (wireless or wireline access). These
scenarios are based on typical reference connections defined in this Recommendation, composed of
various segments, including: terminal, wireless access, backhaul network, core network.
Considerations regarding the sharing of the budget of some key parameters and the location where
they can be assessed across these segments are provided.
History
Edition Recommendation Approval Study Group Unique ID*
1.0 ITU-T G.1028 2016-04-06 12 11.1002/1000/12748
* To access the Recommendation, type the URL http://handle.itu.int/ in the address field of your web
browser, followed by the Recommendation's unique ID. For example, http://handle.itu.int/11.1002/1000/1
1830-en.
NOTE
In this Recommendation, the expression "Administration" is used for conciseness to indicate both a
telecommunication administration and a recognized operating agency.
Compliance with this Recommendation is voluntary. However, the Recommendation may contain certain
mandatory provisions (to ensure, e.g., interoperability or applicability) and compliance with the
Recommendation is achieved when all of these mandatory provisions are met. The words "shall" or some other
obligatory language such as "must" and the negative equivalents are used to express requirements. The use of
such words does not suggest that compliance with the Recommendation is required of any party.
ITU 2016
All rights reserved. No part of this publication may be reproduced, by any means whatsoever, without the prior
written permission of ITU.
1 Scope
This Recommendation works on the assumption that Voice over LTE (VoLTE) is a so-called
''managed'' voice service, in opposition to over the top (OTT) applications without use of session
initiation protocol/IP multimedia subsystem (SIP/IMS) signalling and with no prioritized traffic.
Video-telephony over LTE (ViLTE) is another service which will be addressed in a specific
Recommendation.
This Recommendation describes the key aspects impacting end-to-end performance of managed voice
applications over LTE networks, for the most common call cases (IMS tromboning is not considered,
nor single radio voice call continuity (SRVCC), nor mobility under wireless local access network),
and how they can be properly assessed using current elements of knowledge.
Relevant quality of service (QoS) mechanisms used to manage the voice service, such as robust
header compression (RoHC), transmission time interval (TTI) bundling, semi-persistent scheduling
(SPS), discontinuous transmission (DTX) and reception (DRX), service domain selection (SDS) or
SIP preconditions, are not considered in this Recommendation as a mandatory part of a VoLTE
service, but their impact on end-to-end perceived quality will be taken into account.
Analysis of the impact of VoLTE on quality of supplementary services (such as data streaming) or
on device features (battery life) is outside the scope of this Recommendation.
2 References
The following ITU-T Recommendations and other references contain provisions which, through
reference in this text, constitute provisions of this Recommendation. At the time of publication, the
editions indicated were valid. All Recommendations and other references are subject to revision;
users of this Recommendation are therefore encouraged to investigate the possibility of applying the
most recent edition of the Recommendations and other references listed below. A list of the currently
valid ITU-T Recommendations is regularly published. The reference to a document within this
Recommendation does not give it, as a stand-alone document, the status of a Recommendation.
[ITU-T E.800] Recommendation ITU-T E.800 (2008), Definitions of terms related to
quality of services.
[ITU-T E.804] Recommendation ITU-T E.804 (2014), Quality of service aspects for
popular services in mobile networks.
[ITU-T G.107] Recommendation ITU-T G.107 (2015), The E-model: a computational
model for use in transmission planning.
[ITU-T G.107.1] Recommendation ITU-T G.107.1 (2015), Wideband E-model
[ITU-T G.109] Recommendation ITU-T G.109 (1999), Definition of categories of speech
transmission quality.
[ITU-T G.114] Recommendation ITU-T G.114 (2003), One-way transmission time
[ITU-T G.711] Recommendation ITU-T G.711 (1988), Pulse code modulation (PCM) of
voice frequencies.
[ITU-T G.1000] Recommendation ITU-T G.1000 (2001), Communications quality of
service: A framework and definitions.
3 Definitions
5 Conventions
None.
Several blocks are present and form the basic elements of a reference model:
– The terminal
– The E-UTRAN
This Recommendation provides an overview of the impact of various issues on perceived quality,
together with an estimation of the quantization of this impact by building block of the hypothetical
reference model, for several end-to-end scenarios falling into the scope of this Recommendation.
A client of a VoLTE service can experience different types of calls:
– Basic call: Either with another VoLTE user connected to the same 4G network
(see clause 7.1) or with a user of another voice network (CS or PSTN, see clauses 7.3 and
7.4).
– Circuit switched fall back (CSFB): A call with another 4G terminal, when one of the two
ends must perform a fall back to a CS connection over 3G or 2G before call set up. From a
user point of view, CSFB is automatic and transparent, no action is required. The
performance of CSFB in terms of call set up is seen as a sub-part of basic call performance.
Once the CSFB is performed, the performance objectives in terms of integrity and call
retainability are similar to the ones of a basic call (see clauses 7.3 and 7.4).
– Interconnection: A call between two VoLTE terminals connected to two different
interconnected networks (see clause 7.2).
– IMS tromboning: When the VoLTE terminal is under CS coverage, signalling and user planes
go through the IMS domain. From the e2e performance perspective, this IMS tromboning
should only impact end-to-end delay and post dialling delay (PDD). This call case is outside
the scope of the present Recommendation.
Due to mobility, a call initiated under a 4G VoLTE coverage may have to hand over (HO) to CS
coverage in order to continue. This process, known as SRVCC, is also outside of the current scope of
this Recommendation and under consideration for a further revision.
A call initiated under a 4G VoLTE coverage may also have to hand over to wireless local access
network coverage. A 4G terminal may also directly start a voice call on an IMS platform under this
radio coverage. This use case, known as voice over WiFi (VoWiFi), is also outside of the current
scope of this Recommendation and under consideration for a further revision.
The most common scenarios, considered in this Recommendation, are detailed below.
All scenarios including interconnection to another network may include very long international paths.
This is considered as a separate case and does not lead to considerations for the general budgeting of
delays.
From a customer point of view (QoS required and perceived, as defined in [ITU-T G.1000]), these
degradations are divided into the following categories:
– Call session performance
– Problems of registration to the service (IMS/SIP).
– Call set up issues (bad accessibility).
– Failed continuity (or retainability), including impact of mobility (radio hand-overs and
SRVCC events).
– Perceived speech quality during the call (integrity)
– Frequency content. This refers to the speech spectrum of signals presented to end users
(NB, WB or SWB) and its potential distortions.
– Interruptions. Concerns all events resulting in clipping of the speech signal during the
conversation.
– End to end delay (impact on conversation interactivity)
– Presence of unwanted noises, from whatever origin.
For most of the indicators in Table 2, a budget can be assigned to the various segments that compose
end-to-end paths as seen in clause 6. Tables 3 to 6 provide indications of target values that can be
reasonably reached on each of these segments for each of the hypothetical reference connections
depicted in clause 7. The total budget is not necessarily the exact sum of all individual budgets.
These targets are examples of realistic values that network operators may reach when using tools
complying with up-to-date standards. For instance, the mean opinion scores (MOS) in Tables 3 to 6
are meant as average values when applying [ITU-T P.863] with the right reference sentence (i.e.,
complying with [ITU-T P.863.1]) and doing a small drive test with state-of-the art devices. For longer
LTE-3G communication
LTE-PSTN communication
All measurement points can actually provide data for reporting. Even not fully representative data,
like those gathered from intrusive measurements, can be valuable for this purpose.
The following dashboards can be built based on such measurements:
– General view of the service utilisation (number of customers, number of calls, call durations,
churn rate).
– Performance of service platforms and network equipment (service availability and
continuity).
– QoS counters (availability, PDD, mean opinion score (MOS), call continuity).
As far as it concerns metrics representative of the underlying network layers, [ITU-T Y.1540]
provides information on IP-related metrics, while no ITU-T standards address radio metrics.
10.3.2 Tools and models for the measurement and prediction of voice quality
There are two approaches for the assessment of end-to-end voice quality:
– Parametric tools take advantage of the good correlation between technical information of a
connection and the corresponding end-to-end quality as perceived by end-users, to produce
a relatively accurate estimate at a cheap implementation cost. Such a tool can be envisaged
at edge points, close to the end-user, for a better prediction of individual quality, or inside the
network, for a good knowledge of the general impact of network performance on end-to-end
quality. [ITU-T P.564] describes a general class of parametric voice quality prediction
models that provide highly scalable voice quality estimation using information in the
IP/UDP/RTP header of packets. In addition, [ITU-T P.564] provides performance criteria for
models of this type that operate on narrowband speech.
Table A.1 – degradations related to call session performance and their potential causes
Kind of degradation Possible reasons: Location
Identification Failure – Problem with MME, HSS or PCRF EPC
– Error in scheduling
– Radio resource control (RRC) connection set-up failure
(reception of RRC connection reject, or expiry of timer eUTRAN
T300, no RRC connection set-up complete sent after
reception of RRC connection set-up).
– Not available due to load (serving gateway (SGW) or packet
Unavailability of data network gateway (PGW))
basic call – Failed negotiation (no allocation of QCI, no codec match,
SIP preconditions unmet, etc.)
– Reception of several SIP error codes (e.g., 401 = EPC
Unauthorized, 405 = Method Not Allowed, etc.)
– Reception of SIP CANCEL from IMS
– TD internal timer expired, causing a
''SessionSetupFailureTimeout''
– Load
High post dialling – Interworking between systems
All
delay – Use of SIP preconditions
– CS fall back or IMS tromboning at call set-up
– Bad negotiation between two equipments of the network
Link failure eUTRAN/ EPC
during call establishment (bad codec management)
– Terminal is not able to code or decode speech while the
White call Terminal
signalling is OK for the communication
– Terminal bug, bad covered area, handover/SRVCC failures
due to cells neighbourhood problem, etc.
– RRC connection drop (at reception of RRC connection re- Terminal/
establishment reject, or expiry of timer T301 or in case RRC eUTRAN
connection release is received before new RRC connection
set-up attempt)
Call drop – Link failure: System failure, bad re-negotiation between two
equipments of the network during call.
– Reception of SIP status code 500 (Server Internal Error)
– No RTP packet received during a period longer than EPC
''SessionDropTimeout'' TD internal timer
– No SIP 200 OK on BYE is received within the time measured
by ''SessionHangupTimeout'' TD internal timer
Table A.2 – Degradations related to perceived speech quality and their potential causes
Kind of Possible reasons: Location
degradation
– Disturbing comfort noise generation (CNG) due to bad noise
reduction.
– Noise due to bad electronic implementation on terminal (e.g.,
Noise analogue /digital conversion).
– Disturbing residual noise due to bad noise reduction.
Terminal
– Background noise (street, car, etc.).
– Additional noise due to eUTRAN configuration problem.
– Bad performance of acoustic echo cancellation (AEC)/ No AEC. As
reminder: Acoustic echo is the coupling between the loudspeaker
and the microphone of the phone terminal.
Echo – Bad performance of electric echo cancellation (EEC)/No EEC .
Reminder: Electrical echo is due to digital to analogue
Networks
transformation for a call between mobile terminal and PSTN (No
electrical echo for mobile to mobile call).
Low/high speech
– Bad performance of automatic gain control (AGC)/No AGC. Terminal
level
– Narrowband instead of wideband speech quality:
• Remote terminal not WB
• HO towards 2G Terminal/
• Call with PSTN, 2G, mobile platforms, etc. where wideband eUTRAN
is not deployed.
Encoding /
• Interworking with CS 3G not WB
decoding issues
– Lower WB-AMR bitrate/AMR (Loaded cell, autonomous mode,
etc.) leading to distortion on speech signal.
Terminal/
– Many transcodings (for example with call to voicemail) leading to
eUTRAN
distortion on speech signal
– Rebuffering and time scaling causing distortion
– Although WB-AMR codec is supported, the acoustical performance
of the terminal (on receiving and/or sending side) is not wideband
compliant.
Terminal Acoustic Terminal
– Not well-balanced acoustic terminal can lead to a sound which seems
too aggressive, too muffled, etc.
– Distortion due to transducers.
– Bad VAD/DTX/DRX implementation.
Terminal
– Problem with voice quality enhancement (VQE) algorithm.
Chopped – IP packet loss or jitter in network (congestion, QoS prioritization,
Conversation UL/DL scheduling delays, radio retransmissions, handover).
All
– Bad handling of IP packet loss and inter-arrival jitter by jitter buffers
or packet loss concealment (PLC) inside terminals
DTMF not
– Problem with in-band or out-band processing All
recognized
[b-GSMA IR.34] GSMA IR.34 v 9.1 (2013), Guidelines for IPX Provider networks.
[b-GSMA IR.92] GSMA IR.92 v 7.0 (2013), IMS Profile for Voice and SMS.
Series E Overall network operation, telephone service, service operation and human factors
Series F Non-telephone telecommunication services
Series Y Global information infrastructure, Internet protocol aspects and next-generation networks,
Internet of Things and smart cities
Printed in Switzerland
Geneva, 2016