5G NR NSA DT - CQT KPI Definitions (For Qualcomm Terminals) - R1.1 - 20190617

5G NR NSA DT/CQT KPI Definitions Confidential▲
5G NR NSA DT/CQT KPI

Definitions
For Qualcomm Terminals
R1.1
ZTE Confidential & Proprietary. © 2019 ZTE CORPORATION. All rights reserved. I
LEGAL INFORMATION
Copyright © 2019 ZTE CORPORATION.
The contents of this document are protected by copyright laws and international treaties. Any
reproduction or distribution of this document or any portion of this document, in any form by any
means, without the prior written consent of ZTE CORPORATION is prohibited. Additionally, the
contents of this document are protected by contractual confidentiality obligations.
All company, brand and product names are trade or service marks, or registered trade or service
marks, of ZTE CORPORATION or of their respective owners.
This document is provided “as is”, and all express, implied, or statutory warranties, representations
or conditions are disclaimed, including without limitation any implied warranty of merchantability,
fitness for a particular purpose, title or non-infringement. ZTE CORPORATION and its licensors shall
not be liable for damages resulting from the use of or reliance on the information contained herein.
ZTE CORPORATION or its licensors may have current or pending intellectual property rights or
applications covering the subject matter of this document. Except as expressly provided in any
written license between ZTE CORPORATION and its licensee, the user of this document shall not
acquire any license to the subject matter herein.
ZTE CORPORATION reserves the right to upgrade or make technical change to this product without
further notice. Users may visit ZTE technical support website http://ensupport.zte.com.cn to inquire
related information.
The ultimate right to interpret this product resides in ZTE CORPORATION.
ZTE CORPORATION
Address: NO. 55
Hi-tech Road South
ShenZhen
ZTE Confidential & Proprietary. © 2019 ZTE CORPORATION. All rights reserved. II
P.R.China
518057
Website: http://support.zte.com.cn
Email: 800@zte.com.cn
ZTE Confidential & Proprietary. © 2019 ZTE CORPORATION. All rights reserved. III
Revision History
Product Version Document Version Serial Number Reason for Revision

R1.0 First published
The signaling
statistical points of
R1.1
commercial terminals
were updated.
Author
Date Document Version Prepared by Reviewed by Approved by

2018-10-25 R1.0 Ma Ming Hui Longhua
2019-06-14 R1.1 Wang Feifei Hui Longhua
Intended audience: 5G network optimization or testing personnel
Abstract: This document provides the definitions of test KPIs for 5G commercial terminal and the
statistical points for reference.
Keywords: NR, LTE
Applicable scenario: field 5G DTs or CQTs
ZTE Confidential & Proprietary. © 2019 ZTE CORPORATION. All rights reserved. IV
TABLE OF CONTENTS
1 eMBB ............................................................................................................... 1
1.1 KPIs Related to Coverage ................................................................................ 1
1.1.1 LTE................................................................................................................... 1
1.1.2 NR .................................................................................................................... 4
1.2 KPIs Related to Call Setup ............................................................................. 10
1.2.1 LTE................................................................................................................. 10
1.2.2 NR .................................................................................................................. 14
1.3 KPIs Related to Retainability .......................................................................... 15
1.3.1 LTE................................................................................................................. 15
1.3.2 NR .................................................................................................................. 16
1.4 KPIs Related to Mobility Management ............................................................ 17
1.4.1 LTE................................................................................................................. 17
1.4.2 NR .................................................................................................................. 18
1.4.3 LTE&NR ......................................................................................................... 19
1.5 Indicated Related to Delay .............................................................................. 20
1.5.1 LTE................................................................................................................. 20
1.5.2 NR .................................................................................................................. 25
1.5.3 NR & LTE ....................................................................................................... 29
1.6 KPIs Related to Service Classes .................................................................... 29
1.6.1 LTE................................................................................................................. 29
1.6.2 NR & LTE ....................................................................................................... 31
1.6.3 PING Packet Loss Rate .................................................................................. 31
1.6.4 NSA Peak DL Throughput .............................................................................. 31
1.6.5 NSA Peak UL Throughput .............................................................................. 32
1.6.6 NSA Average DL Throughput ......................................................................... 32
1.6.7 NSA Average UL Throughput ......................................................................... 32
ZTE Confidential & Proprietary. © 2019 ZTE CORPORATION. All rights reserved. V
FIGURES
Figure 1-1 RRC Connection Setup Procedure .................................................................. 11

Figure 1-2 E-RAB Setup Procedure.................................................................................. 12
Figure 1-3 Attach Signaling Flow .................................................................................... 13
Figure 1-4 Signaling Flow of a Service Request ............................................................... 14
Figure 1-5 Signaling Flow of SN Addition ......................................................................... 15
Figure 1-6 Signaling Flow of an LTE Call Drop ................................................................. 16
Figure 1-7 Signaling Flow of LTE Handover ..................................................................... 18
Figure 1-8 Signaling Flow of NR Handover....................................................................... 19
Figure 1-9 RRC Connection Setup Time .......................................................................... 20
Figure 1-10 Attach Time ................................................................................................... 21
Figure 1-11 Idle-to-Connected Time ................................................................................. 22
Figure 1-12 LTE Handover Time on the Control Plane ..................................................... 23
Figure 1-13 VoLTE Call Setup Time ................................................................................. 24
Figure 1-14 CSFB Call Setup Time .................................................................................. 25
Figure 1-15 SN Setup Time .............................................................................................. 26
Figure 1-16 NSA Delay on the Control Plane ................................................................... 27
Figure 1-17 Secondary Node Change Delay .................................................................... 29
Figure 1-18 VoLTE Call Setup Procedure......................................................................... 30
Figure 1-19 CSFB Call Setup Procedure .......................................................................... 31
TABLES
Table 1-1 Definition of RSRP.............................................................................................. 1

Table 1-2 RSRP in the Protocol.......................................................................................... 2
Table 1-3 Definition of RS-SINR ......................................................................................... 2
Table 1-4 RS-SINR in the Protocol ..................................................................................... 3
Table 1-5 Definition of LTE Coverage Rate ........................................................................ 4
Table 1-6 Definition of SS-RSRP ...................................................................................... 4
ZTE Confidential & Proprietary. © 2019 ZTE CORPORATION. All rights reserved. VI
Table 1-7 SS-RSRP in the Protocol .................................................................................... 6

Table 1-8 Definition of SS-SINR ....................................................................................... 6
Table 1-9 SS-SINR in the Protocol ................................................................................... 7
Table 1-10 Definition of CSI-RSRP ................................................................................... 8
Table 1-11 CSI-RSRP in the Protocol................................................................................. 8
Table 1-12 Definition of CSI-SINR .................................................................................... 9
Table 1-13 CSI-SINR in the Protocol .................................................................................. 9
Table 1-14 Definition of NSA Coverage Rate ..................................................................... 9
ZTE Confidential & Proprietary. © 2019 ZTE CORPORATION. All rights reserved. VII
Confidential▲
1 eMBB
1.1 KPIs Related to Coverage
1.1.1 LTE
1.1.1.1 RSRP
Table 1-1 Definition of RSRP
KPI Time Granularity NE Granularity

RSRP -
Meaning
RSRP is a key performance indicator (KPI) to measure the radio network coverage
rate of a system. It is an absolute value that indicates the strength of received signals.
Because it can reflect the distance between the UE and the base station to some
extent, it can be used to measure the coverage range of a cell. RSRP is a linear
average power on the resource elements that carry cell reference signals.
KPI Definition
KPI formula:
Set the RSRP threshold as A. RSRP coverage rate = Number of samples with RSRP
greater than A / Total number of samples in the drive test * 100%
Before the calculation, exclude the abnormal samples in the test results. An abnormal
sample means that the RSRP value is far beyond the normal range.
Relevant Counters
Null
Remarks
The data is obtained through a drive test.
ZTE Confidential & Proprietary. © 2019 ZTE CORPORATION. All rights reserved. 1
Confidential▲
Table 1-2 RSRP in the Protocol
Reference signal received power (RSRP), is defined as the linear

average over the power contributions (in [W]) of the resource
elements that carry cell-specific reference signals within the
considered measurement frequency bandwidth.
For RSRP determination the cell-specific reference signals R0

according to TS 36.211 [3] shall be used. If the UE can reliably
detect that R1 is available, it may use R1 in addition to R0 to
determine RSRP.
If higher layers indicate measurements based on discovery signals,

Definition the UE shall measure RSRP in the subframes in the configured
discovery signal occasions. For frame structure 1 and 2, if the UE
can reliably detect that cell-specific reference signals are present in
other subframes, the UE may use those subframes in addition to
determine RSRP.
The reference point for the RSRP shall be the antenna connector of
the UE.
If receiver diversity is in use by the UE, the reported value shall not
be lower than the corresponding RSRP of any of the individual
diversity branches.
RRC_IDLE intra-frequency,
RRC_IDLE inter-frequency,
Applicable for
RRC_CONNECTED intra-frequency,
RRC_CONNECTED inter-frequency
1.1.1.2 RS-SINR
Table 1-3 Definition of RS-SINR

RS-CINR -
Meaning
RS-CINR refers to the carrier to interference plus noise ratio measured by an UE on
an RS channel. It is one of the KPIs indicating channel quality.
KPI Definition
RS-CINR is defined as the strength of useful RS signals as compared with
interference (or noise or interference plus noise), which is measured by the UE. In the
simulation tool CNP, RS-CINR = RSRP of the serving cell / (RSRP of the neighbor
cell + N); N is the thermal noise power.
Confidential▲
Relevant Counters
Null
Remarks
Table 1-4 RS-SINR in the Protocol
Reference signal-signal to noise and interference ratio (RS-SINR),

is defined as the linear average over the power contribution (in [W])
of the resource elements carrying cell-specific reference signals
divided by the linear average of the noise and interference power
contribution (in [W]) over the resource elements carrying cell-
specific reference signals within the same frequency bandwidth.
For RS-SINR determination, the cell-specific reference signals R0

according TS 36.211 [3] shall be used.
Definition
The reference point for the RS-SINR shall be the antenna connector
of the UE.
If receiver diversity is in use by the UE, the reported value shall not
be lower than the corresponding RS-SINR of any of the individual
diversity branches.
If higher-layer signalling indicates certain subframes for performing

RS-SINR measurements, then RS-SINR is measured in the
indicated subframes.
Applicable for
Confidential▲
1.1.1.3 Coverage Rate
Table 1-5 Definition of LTE Coverage Rate

Coverage Rate - Cell
Meaning
The radio network coverage rate reflects the network availability.
KPI Definition
KPI formula:
F = RSRP≥R and RS-CINR≥S
Here RSRP indicates the downlink (DL) reference signal received power. RS-CINR
indicates the signal quality of received reference signals. RSRP≥R and RS-CINR≥S
indicate the conditions. R and S are the RSRP and RS-CINR thresholds in the
calculation. If the conditions of RSRP≥R and RS-CINR≥S are both satisfied, F is set
to 1. If one or both of them are not satisfied, F is set to 0. Before the calculation,
exclude the abnormal samples in the test results. An abnormal sample means that the
RSRP or RS-CINR value is far beyond the normal range.
This formula indicates that if the received signal power of an area exceeds a
threshold and meanwhile the signal quality exceeds a threshold, the area is covered.
The coverage rate is defined as the percentage of the test points with the F values
equal to 1 in the test area.
Note: The coverage rate here refers to the coverage rate of an area rather than the
coverage rate on cell edge. The coverage rate test on cell edge is quite complicated,
and it is considered here.
Relevant Counters
Null
Remarks
1.1.2 NR
1.1.2.1 SS-RSRP
Table 1-6 Definition of SS-RSRP

SS-RSRP -
Meaning
Confidential▲
SS-RSRP is a KPI to measure the radio network coverage rate of a system. It is an

absolute value that indicates the strength of the received signal. Because it can
reflect the distance between the UE and the base station to some extent, it can be
used to measure the coverage range of a cell. RSRP is a linear average power on the
resource elements that carry cell reference signals.
KPI Definition
KPI formula:
Set the SS-RSRP threshold as A. SS-RSRP coverage rate = Number of samples
with SS-RSRP greater than A / Total number of samples in the drive test * 100%
sample means that the SS-RSRP value is far beyond the normal range.
Relevant Counters
Null
Remarks
Confidential▲
Table 1-7 SS-RSRP in the Protocol
SS reference signal received power (SS -RSRP) is defined as the

linear average over the power contributions (in [W]) of the resource
elements that carry secondary synchronization signals (SS). The
measurement time resource(s) for SS-RSRP are confined within
SS/PBCH Block Measurement Time Configuration (SMTC) window
duration.
For SS-RSRP determination demodulation reference signals for

physical broadcast channel (PBCH) and, if indicated by higher
layers, CSI reference signals in addition to secondary
synchronization signals may be used. SS-RSRP using
demodulation reference signal for PBCH or CSI reference signal
shall be measured by linear averaging over the power contributions
of the resource elements that carry corresponding reference signals
taking into account power scaling for the reference signals as
defined in 3GPP TS 38.213 [5].
Definition
SS-RSRP shall be measured only among the reference signals
corresponding to SS/PBCH blocks with the same SS/PBCH block
index and the same physical-layer cell identity.
If higher-layers indicate certain SS/PBCH blocks for performing SS-

RSRP measurements, then SS-RSRP is measured only from the
indicated set of SS/PBCH block(s).
For frequency range 1, the reference point for the SS-RSRP shall
be the antenna connector of the UE. For frequency range 2, SS-
RSRP shall be measured based on the combined signal from
antenna elements corresponding to a given receiver branch. For
frequency range 1 and 2, if receiver diversity is in use by the UE,
the reported SS-RSRP value shall not be lower than the
corresponding SS-RSRP of any of the individual receiver branches.
RRC_IDLE intra-frequency,
RRC_IDLE inter-frequency,
RRC_INACTIVE intra-frequency,
Applicable for
RRC_INACTIVE inter-frequency,
1.1.2.2 SS-SINR
Table 1-8 Definition of SS-SINR
Confidential▲

SS-SINR -
Meaning
SS-SINR refers to the carrier to interference plus noise ratio measured by an UE
on an SSB channel. It is one of the KPIs indicating channel quality.
KPI Definition
SS-SINR defined as the strength of useful SSB signals as compared with
interference (or noise or interference plus noise), which is measured by the UE.
Relevant Counters
Null
Remarks
Table 1-9 SS-SINR in the Protocol
SS signal-to-noise and interference ratio (SS-SINR), is defined as

the linear average over the power contribution (in [W]) of the
resource elements carrying secondary synchronisation signals
divided by the linear average of the noise and interference power
contribution (in [W]) over the resource elements carrying secondary
synchronisation signals within the same frequency bandwidth. The
measurement time resource(s) for SS-SINR are confined within
SS/PBCH Block Measurement Time Configuration (SMTC) window
duration.
For SS-SINR determination demodulation reference signals for

physical broadcast channel (PBCH) in addition to secondary
Definition synchronization signals may be used.
If higher-layers indicate certain SS/PBCH blocks for performing SS-

SINR measurements, then SS-SINR is measured only from the
indicated set of SS/PBCH block(s).
For frequency range 1, the reference point for the SS-SINR shall be
the antenna connector of the UE. For frequency range 2, SS-SINR
shall be measured based on the combined signal from antenna
elements corresponding to a given receiver branch. For frequency
range 1 and 2, if receiver diversity is in use by the UE, the reported
SS-SINR value shall not be lower than the corresponding SS-SINR
of any of the individual receiver branches.
Applicable for
Confidential▲
1.1.2.3 CSI-RSRP
Table 1-10 Definition of CSI-RSRP

CSI-RSRP -
Meaning
CSI-RSRP is a KPI to measure the radio network coverage rate of a system. It is an
absolute value that indicates the strength of received signals. Because it can reflect
the distance between the UE and the base station to some extent, it can be used to
measure the coverage range of a cell. RSRP is a linear average power on the
resource elements that carry cell reference signals.
KPI Definition
KPI formula:
Set the CSI-RSRP threshold as A. CSI-RSRP RSRP coverage rate = Number of
samples with RSRP greater than A / Total number of samples in the drive test * 100%
sample means that the CSI-RSRP value is far beyond the normal range.
Relevant Counters
Null
Remarks
Table 1-11 CSI-RSRP in the Protocol
CSI reference signal received power (CSI-RSRP), is defined as the

linear average over the power contributions (in [W]) of the resource
elements that carry CSI reference signals configured for RSRP
measurements within the considered measurement frequency
bandwidth in the configured CSI-RS occasions.
For CSI-RSRP determination CSI reference signals transmitted on

antenna port [300X] or antenna ports [300Y], [300Z] according to
Definition 3GPP TS 38.211 [4] shall be used.
For frequency range 1, the reference point for the CSI-RSRP shall
be the antenna connector of the UE. For frequency range 2, CSI-
RSRP shall be measured based on the combined signal from
the reported CSI-RSRP value shall not be lower than the
corresponding CSI-RSRP of any of the individual receiver branches.
Applicable for
Confidential▲
1.1.2.4 CSI-SINR
Table 1-12 Definition of CSI-SINR

CSI-SINR -
Meaning
CSI-SINR refers to the carrier to interference plus noise ratio measured by an UE on
a traffic channel. It is one of the KPIs indicating channel quality.
KPI Definition
CSI-SINR is defined as the strength of useful CSI-RS signals as compared with
interference (or noise or interference plus noise), which is measured by the UE.
Relevant Counters
Null
Remarks
Table 1-13 CSI-SINR in the Protocol
CSI signal-to-noise and interference ratio (CSI-SINR), is defined as

the linear average over the power contribution (in [W]) of the
resource elements carrying CSI reference signals divided by the
linear average of the noise and interference power contribution (in
[W]) over the resource elements carrying CSI reference signals
reference signals within the same frequency bandwidth.
For CSI-SINR determination CSI reference signals transmitted on

Definition antenna port [300X] according to 3GPP TS 38.211 [4] shall be used.
For frequency range 1, the reference point for the CSI-SINR shall
be the antenna connector of the UE. For frequency range 2, CSI-
SINR shall be measured based on the combined signal from
the reported CSI-SINR value shall not be lower than the
corresponding CSI-SINR of any of the individual receiver branches.
Applicable for
1.1.2.5 Coverage Rate
Table 1-14 Definition of NSA Coverage Rate
Confidential▲
Coverage Rate - Cell

Meaning
The radio network coverage rate reflects the network availability.
KPI Definition
KPI formula:
F= RSRP≥R and SINR≥S,
Here RSRP indicates the DL RSRP. SINR indicates the signal quality of received
reference signals. RSRP≥R and SINR≥S indicate the conditions. R and S are the
RSRP and SINR thresholds in the calculation. If the conditions of RSRP≥R and
SINR≥S are both satisfied, F is set to 1. If one or both of them are not satisfied, F is
set to 0. Before the calculation, exclude the abnormal samples in the test results. An
abnormal sample means that the RSRP or SINR value is far beyond the normal
range.
This formula indicates that if the received signal power of an area exceeds a
threshold and meanwhile the signal quality exceeds a threshold, the area is covered.
The coverage rate is defined as the percentage of the test points with the F values
equal to 1 in the test area.
Note: The coverage rate here refers to the coverage rate of an area rather than the
coverage rate on cell edge. The coverage rate test on cell edge is quite complicated,
and it is considered here.
Relevant Counters
Null
Remarks
The RSRP defined in this section can be SS-RSRP or CSI-RSRP, and the SINR can be
SS-SINR or CSI-SINR.
1.2 KPIs Related to Call Setup
1.2.1 LTE
1.2.1.1 RRC Connection Setup Success Rate
KPI Definition:
This KPI reflects the probability of successful setup after the UE initiates an RRC
connection setup request, and it takes all the causes into account. It can reflect the user
experience about network accessibility to some extent.
Formula:
Confidential▲
RRC Connection Setup Success Rate = Number of successful RRC connection setup
attempts / Number of RRC connection setup attempts
Signaling Statistical Points:
[Number of RRC connection setup attempts] The signaling statistical point is ① as shown
in the following figure.
[Number of successful RRC connection setup attempts] The signaling statistical point is
② as shown in the following figure.
Figure 1-1 RRC Connection Setup Procedure
1.2.1.2 E-RAB Setup Success Rate
KPI Definition:
This KPI indicates the probability that a UE successfully establishes a service in a cell. It
can reflect the user experience about service establishment in a cell to some extent.
Formula:
E-RAB Setup Success Rate = Number of E-RAB setup successes / Number of E-RAB
setup requests
[Number of E-RAB setup requests] The signaling statistical point is ① as shown in the
following figure.
[Number of E-RAB setup successes] he signaling statistical point is ② as shown in the

following figure.
Confidential▲
Figure 1-2 E-RAB Setup Procedure
1.2.1.3 Attach Success Rate
KPI Definition:
This KPI indicates the conditions of network attachment, and it can reflect the accessibility
of the radio network.
Formula:
Attach Success Rate = Number of attach successes / Number of attach requests
[Number of attach requests] The signaling statistical point is ① as shown in the following
figure.
[Number of attach successes] The signaling statistical point is ③ as shown in the

following figure.
Confidential▲
Figure 1-3 Attach Signaling Flow
1.2.1.4 Service Request Success Rate (Idle to Connect)
KPI Definition/Formula:
Service Request Success Rate = Number of times of sending

RRCConnectionReconfigurationComplete / Number of times of sending MSG1
[Number of times of sending MSG1] The signaling statistical point is ① as shown in the
following figure.
[Number of times of sending RRCConnectionReconfigurationComplete] The signaling

statistical point is ② as shown in the following figure.
Confidential▲
Figure 1-4 Signaling Flow of a Service Request
RRCConnectionReconfigurationComplete: The reconfiguration for the default bearer

setup has completed.
1.2.2 NR
1.2.2.1 SN Addition (NR RAB Setup Success Rate)
KPI Definition:
SN addition in the attachment or service request phase is considered as an NSA access

in the statistics.
The process starts with the RRC reconfiguration message for SN addition and ends with
the MSG2 message received from the NR side.
Formula:
NR RAB Setup Success Rate = Number of MSG2 messages received from the NR side /
Number of RRC reconfiguration messages for SN addition
[Number of RRC reconfiguration messages for SN addition] The signaling statistical point
is ① as shown in the following figure.
Confidential▲
[Number of MSG2 messages received from the NR side /] The signaling statistical point
is ② as shown in the following figure.
Figure 1-5 Signaling Flow of SN Addition
Abnormal Samples:
1. If SCG Failure Information is triggered after SN addition fails because the timer
expires (refer to T304 of NR) or because the random access fails (delivered at the
MAC layer), use the subsequent SN re-addition for calculation.
2. If the application of the reconfiguration message fails, an RRC release message sent
by the 4G eNodeB will be received. This case is considered as not connected.
1.3 KPIs Related to Retainability
1.3.1 LTE
1.3.1.1 Call Drop Rate
From the perspective of the foreground, a call drop means that the RRC connection
reestablishment request is rejected, no response is received, or the UE fails to search for
the network and switches to the IDLE status after the loss of synchronism.
Confidential▲
Figure 1-6 Signaling Flow of an LTE Call Drop
(Number of reestablishment requests rejected + Number of reestablishment requests

without response + Number of times of out-of-sync UE switching to IDLE state) / Number
of RRC connection setup attempts
T1 (customized for a Japanese operator): (Number of reestablishment requests rejected

+ Number of times of out-of-sync UE switching to IDLE state) / Test duration (minutes)
1.3.2 NR
1.3.2.1 Link Failure
Solution: If the NR link fails, the LTE sends a reconfiguration message that carries the SN
release information element.
Confidential▲
1.4 KPIs Related to Mobility Management
1.4.1 LTE
KPI Definition:
Handover Success Rate = Number of handover successes / Number of handover requests
Denominator: Number of times that an RRCConnectionReconfiguration message,

including the MobilityControInfo information element, is received.
Numerator: Number of times that the corresponding

RRCConnectionReconfigurationComplete message is received
[Number of handover requests] The signaling statistical point is ② as shown in the

following figure.
[Number of handover successes] The signaling statistical point is ③ as shown in the

following figure.
Confidential▲
Figure 1-7 Signaling Flow of LTE Handover
1.4.2 NR
KPI Definition:
The NR KPIs are collected during long-call services.
[Success rate of NR intra-site change] = Number of MSG2 of the new cell / Number of
reconfiguration commands delivered by the SN
[Success rate of NR inter-site change] = Number of MSG2 of the new SN / Number of

reconfiguration commands delivered by the MN (this signaling includes the release of the
old SN and the addition of the new SN).
[Number of handover requests] The signaling statistical point is ① as shown in the

following figure.
[Number of handover successes] The signaling statistical point is ② as shown in the

following figure.
Confidential▲
Figure 1-8 Signaling Flow of NR Handover
Abnormal Samples:
1. An NR intra-site change fails, triggering SCG Failure Information, and the cause
value is change failure.
2. An NR inter-site change fails, triggering SCG Failure Information, and the cause
value is timer expiry (refer to T304 of NR) or random access failure (delivered at the
MAC layer).
1.4.3 LTE&NR
Confidential▲
1.5 Indicated Related to Delay
1.5.1 LTE
1.5.1.1 RRC Connection Setup Time
KPI Definition:
RRC Connection Setup Time = RRC Connection Setup Complete T2 – RRC Connection
Request T1
T1: RRC Connection Request is triggered.
T2: RRC Connection Setup Complete is sent.
Figure 1-9 RRC Connection Setup Time
1.5.1.2 Attach Time
KPI Definition:
Attach time = ATTACH_COMPLETE T2 – Attach_REQ T1
T1: Attach_REQ is triggered.
T2: ATTACH_COMPLETE is sent.
Confidential▲
Figure 1-10 Attach Time
1.5.1.3 Idle-to-Connected Time
KPI Definition:
The UE transition from idle state to connected state starts from the time when the UE
sends the first random access preamble and ends at the time when the UE sends the
RRC Connection Reconfiguration Complete message.
Idle-to-Connected Time = Time point at which the UE sends RRC Connection

Reconfiguration Complete T2 – Time point at which the UE in idle state initiates random
access MSG1 T1
T1: MSG1 for random access is triggered.
Confidential▲
T2: RRC Connection Reconfiguration Complete is sent.
Figure 1-11 Idle-to-Connected Time
1.5.1.4 HO Time
KPI Definition:
Handover Time on the Control Plane = Time point at which the MSG2 from the target cell
is received T3 – Time point of the RRCConnectionReconfiguration message (including
the MobilityControInfo information element) T1
T1: Time point of the RRCConnectionReconfiguration message (including the

MobilityControInfo information element).
T3: Time point at which the MSG2 from the target cell is received.
Confidential▲
Figure 1-12 LTE Handover Time on the Control Plane
1.5.1.5 VoLTE Call Setup Time
KPI Definition:
VoLTE Call Setup Time = Time point at which the calling UE receives the SIP 180 Ring
message from the network side T2 – Time point at which the calling UE sends the SIP
INVITE message to the core network T1
T1: Time point at which the calling UE sends the SIP INVITE message
T2: Time point at which the calling UE receives the SIP 180 Ring message
Confidential▲
Figure 1-13 VoLTE Call Setup Time
1.5.1.6 CSFB Call Setup Time
KPI Definition:
VoLTE Call Setup Time = Time point at which the UE at the GSM side receives an
Altering message T2 – Time point at which the calling UE originates the Extended Service
Request (ESR) at the LTE side T1
Confidential▲
T1: Time point at which the calling UE originates the ESR at the LTE side
T2 Time point at which the calling UE at the GSM side receives an Altering message
Figure 1-14 CSFB Call Setup Time
1.5.2 NR
1.5.2.1 SN Setup Time
KPI Definition:
Confidential▲
SN Setup Time = Time point at which the NR RRCReconfigurationComplete message

from the UE is received T2 – Time point of the RRCConnectionReconfiguration message
for SN addition T1
T1: Time point of the RRCConnectionReconfiguration message sent from the network
side
T2: Time point at which the NR RRCReconfigurationComplete message from the UE is

received
Figure 1-15 SN Setup Time
1.5.2.2 NSA Delay on the Control Plane
KPI Definition:
NSA Delay on the Control Plane = Time point of the NR RRCReconfigurationComplete

message sent by the UE T2 – Time point of the RRCConnectionRequest message sent
from the UE T1
NSA Delay on the Control Plane = T2 – T1
T1: Time point of the RRCConnectionRequest message sent from the UE
T2: Time point of the NR RRCReconfigurationComplete message sent by the UE
Confidential▲
Figure 1-16 NSA Delay on the Control Plane
Confidential▲
1.5.2.3 Secondary Node Change Delay
KPI Definition:
NR intra-site change delay = Time point of the NR RRCReconfigurationComplete

message received by the network side T2 – Time point of the NR RRCReconfiguration
message sent from the network side T1
T1: Time point of the NR RRCReconfiguration message sent from the network side
T2: Time point of the NR RRCReconfigurationComplete message received by the network

side
Confidential▲
Figure 1-17 Secondary Node Change Delay
1.5.3 NR & LTE
1.5.3.1 PING Delay
Note: The PING delay cannot be identified at the foreground. To collect this KPI data, the
engineers need to configure the SCG mode at the background and conduct a test.
1.5.3.2 NSA Handover Scenario and Definition of NSA Handover Scenario
1.6 KPIs Related to Service Classes
1.6.1 LTE
1.6.1.1 VoLTE Call Setup Success Rate
VoLTE Call Setup Success Rate = Number of successfully completed calls / Total number
of calls initiated by the UE
[Call initiated by the UE] The signaling statistical point is ① as shown in the following
figure.
[Successfully completed call] The signaling statistical point is ② as shown in the following
figure.
Confidential▲
Figure 1-18 VoLTE Call Setup Procedure
1.6.1.2 CSFB Setup Success Rate
CSFB Setup Success Rate = Number of successful call setup attempts / Total number of
CSFB call setup requests initiated by the UE
[CSFB call setup request initiated by the UE] The signaling statistical point is ① as shown
in the following figure.
[Successful call setup attempt] The signaling statistical point is ② as shown in the
following figure.
Confidential▲
Figure 1-19 CSFB Call Setup Procedure
1.6.2 NR & LTE
1.6.3 PING Packet Loss Rate
Note: The PING packet loss rate cannot be identified at the foreground. To collect this KPI
data, the engineers need to configure the SCG mode at the background and conduct a
test.
1.6.4 NSA Peak DL Throughput
KPI Definition:
Confidential▲
Peak throughput is the ultimate data rate that a single UE can obtain in a cell. It is
measured in the best radio environment and can reflect the ultimate throughput of the
equipment.
1.6.5 NSA Peak UL Throughput
KPI Definition:
Peak throughput is the ultimate data rate that a single UE can obtain in a cell. It is
measured in the best radio environment and can reflect the ultimate throughput of the
equipment.
1.6.6 NSA Average DL Throughput
KPI Definition:
DL average throughput is the average data rate that a single UE can obtain at different
places (in different radio environments) under a cell. It can reflect the average throughput
at different SINR points under the cell when there is interference.
DL average throughput indicates the average DL data rate that a single UE can obtain
along the whole test route and reflects the average throughput of the whole network.
1.6.7 NSA Average UL Throughput
KPI Definition:
Average throughput is the average data rate that a single UE can obtain at different places
(in different radio environments) under a cell. It can reflect the average throughput at
different SINR points under the cell when there is interference.
Average throughput indicates the average UL data rate that a single UE can obtain along
the whole test route and reflects the average throughput of the whole network.

5G NR NSA DT - CQT KPI Definitions (For Qualcomm Terminals) - R1.1 - 20190617

Uploaded by

Copyright:

Available Formats

5G NR NSA DT - CQT KPI Definitions (For Qualcomm Terminals) - R1.1 - 20190617

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

5G NR NSA DT - CQT KPI Definitions (For Qualcomm Terminals) - R1.1 - 20190617

Uploaded by

Copyright:

Available Formats

5G NR NSA DT/CQT KPI Definitions Confidential▲

5G NR NSA DT/CQT KPI

Copyright © 2019 ZTE CORPORATION.

The ultimate right to interpret this product resides in ZTE CORPORATION.

Hi-tech Road South

Product Version Document Version Serial Number Reason for Revision

Date Document Version Prepared by Reviewed by Approved by

Intended audience: 5G network optimization or testing personnel

Keywords: NR, LTE

Applicable scenario: field 5G DTs or CQTs

Figure 1-1 RRC Connection Setup Procedure .................................................................. 11

Table 1-1 Definition of RSRP.............................................................................................. 1

Table 1-7 SS-RSRP in the Protocol .................................................................................... 6

1.1 KPIs Related to Coverage

Table 1-1 Definition of RSRP

KPI Time Granularity NE Granularity

Table 1-2 RSRP in the Protocol

Reference signal received power (RSRP), is defined as the linear

For RSRP determination the cell-specific reference signals R0

If higher layers indicate measurements based on discovery signals,

Table 1-3 Definition of RS-SINR

KPI Time Granularity NE Granularity

Table 1-4 RS-SINR in the Protocol

Reference signal-signal to noise and interference ratio (RS-SINR),

For RS-SINR determination, the cell-specific reference signals R0

If higher-layer signalling indicates certain subframes for performing

1.1.1.3 Coverage Rate

Table 1-5 Definition of LTE Coverage Rate

KPI Time Granularity NE Granularity

Table 1-6 Definition of SS-RSRP

KPI Time Granularity NE Granularity

SS-RSRP is a KPI to measure the radio network coverage rate of a system. It is an

Table 1-7 SS-RSRP in the Protocol

SS reference signal received power (SS -RSRP) is defined as the

For SS-RSRP determination demodulation reference signals for

If higher-layers indicate certain SS/PBCH blocks for performing SS-

Table 1-8 Definition of SS-SINR

KPI Time Granularity NE Granularity

Table 1-9 SS-SINR in the Protocol

SS signal-to-noise and interference ratio (SS-SINR), is defined as

For SS-SINR determination demodulation reference signals for

If higher-layers indicate certain SS/PBCH blocks for performing SS-

Table 1-10 Definition of CSI-RSRP

KPI Time Granularity NE Granularity

Table 1-11 CSI-RSRP in the Protocol

CSI reference signal received power (CSI-RSRP), is defined as the

For CSI-RSRP determination CSI reference signals transmitted on

Table 1-12 Definition of CSI-SINR

KPI Time Granularity NE Granularity

Table 1-13 CSI-SINR in the Protocol

CSI signal-to-noise and interference ratio (CSI-SINR), is defined as

For CSI-SINR determination CSI reference signals transmitted on

1.1.2.5 Coverage Rate

Table 1-14 Definition of NSA Coverage Rate

KPI Time Granularity NE Granularity

Coverage Rate - Cell

1.2 KPIs Related to Call Setup

1.2.1.1 RRC Connection Setup Success Rate

Signaling Statistical Points: