Distinguishing Reference Intervals and Clinical Decision Limits
Distinguishing Reference Intervals and Clinical Decision Limits
Distinguishing Reference Intervals and Clinical Decision Limits
Yesim Ozarda, Ken Sikaris, Thomas Streichert, Joseph Macri & on behalf of
IFCC Committee on Reference intervals and Decision Limits (C-RIDL)
To cite this article: Yesim Ozarda, Ken Sikaris, Thomas Streichert, Joseph Macri & on
behalf of IFCC Committee on Reference intervals and Decision Limits (C-RIDL) (2018):
Distinguishing reference intervals and clinical decision limits – A review by the IFCC Committee
on Reference Intervals and Decision Limits, Critical Reviews in Clinical Laboratory Sciences, DOI:
10.1080/10408363.2018.1482256
REVIEW ARTICLE
Abbreviations: ADA: American Diabetes Association; ALT: alanine aminotransferase; Apo A: apoli-
poprotein A; Apo B: apolipoprotein B; BMI: body mass index; BNP: B-type natriuretic peptide;
CA125: carbohydrate antigen 125; CDLs: clinical decision limits; CLSI: Clinical Laboratory Standards
Institute; C-RIDL: Committee on Reference Intervals and Decision Limits; CRP: C-reactive protein;
cTn: cardiac troponin; CVD: cardiovascular disease; CVi: within-individual CV; DM: diabetes melli-
tus; EFLM: European Federation of Laboratory Medicine; ERSPC: The European Randomized Study
of Screening for Prostate Cancer; GDM: gestational diabetes mellitus; GGT: gamma glutamyl-trans-
ferase; HAPO: Hyperglycemia and Adverse Pregnancy Outcome; HbA1c: hemoglobin A1c; HDL-C:
high-density lipoprotein cholesterol; IADPSG: International Association of Diabetes and Pregnancy
Study Groups; IFCC: International Federation of Clinical Chemistry and Laboratory Medicine; ISO:
International Organization for Standardization; LDL-C: low-density lipoprotein cholesterol; non-
HDL-C: non-HDL-cholesterol; PLCO: Prostate, Lung, Colorectal, and Ovarian Cancer Screening Trial;
PSA: prostate specific antigen; RIs: reference intervals; ROC: receiver operator characteristic
Introduction
diseased?” and “Is the patient worsening?”. The value of
Every laboratory request has a purpose, with specific laboratory test results is in answering these questions
questions such as “Is the patient healthy?” “Is the so that effective interventions can be applied to
patient at risk of developing a disease?” “Is the patient improve clinical outcomes.
CONTACT Yesim Ozarda yesim@uludag.edu.tr Department of Medical Biochemistry, Uludag University School of Medicine, Bursa, Turkey
ß 2018 Informa UK Limited, trading as Taylor & Francis Group
2 Y. OZARDA ET AL.
The first question (“Is the patient healthy or not may be used. The most obvious example is fasting glu-
healthy?”) relates to reference intervals (RIs) that cose, where several decision limits are defined: a level
describe the typical distribution of results seen in an 3.9 mmol/L (70 mg/dL) for the diagnosis of hypogly-
apparently healthy reference population [1]. In the trad- cemia [2.2 mmol/L (40 mg/dL) for life-threatening
itional approach to establishing RIs, termed the “direct” hypoglycemia] [20]; 5.6–6.9 mmol/L (100–124 mg/dL) for
approach, the RI is typically defined as the interval an increased risk of diabetes or prediabetes; and
between the two reference limits (2.5th and 97.5th per- 7.0 mmol/L (125 mg/dL) for diabetes mellitus
centiles) derived from the distribution of results (DM) [21].
obtained from a sample of the reference population [2]. RIs are focused on optimizing specificity (typically to
Historically such ranges have been called “normal 95%) while CDLs are also focused on optimizing sensi-
ranges” [3], but this term has long been considered to tivity for the disease. In other clinical circumstances that
be ambiguous [4] and subject to misuse [5] and is now place importance on both sensitivity and specificity,
formally avoided by the International Federation of optimal limits may be derived from receiver operator
Clinical Chemistry and Laboratory Medicine (IFCC) [2] characteristic (ROC) curves, which balance sensitivity
and International Organization for Standardization (ISO) and specificity [22] (Table 1). Ideally, a Bayesian
[6]. About 30 years ago, the IFCC published a series of approach is also required to balance pretest probability
six articles to clarify this concept [7–12], and over the or prevalence against sensitivity and specificity [23].
last decade, the IFCC’s Committee on Reference “Optimal limits” derived from ROC curves, an intermedi-
Intervals and Decision Limits (C-RIDL) has focused on ate category of threshold, are a compromise between
direct common RIs; it has developed guidelines on con- specificity and sensitivity [24].
ducting such studies and has conducted multicenter This review describes the differences between RIs
studies to derive common RIs at a national level and CDLs, gives definitions and provides examples to
[13–15]. An alternative approach is to perform data- help readers to avoid confusion. We also consider the
mining of results that have been generated as part of preanalytical, analytical, and postanalytical factors influ-
routine clinical pathology testing and then to use encing them and apply the principles of analytical qual-
appropriate statistical techniques to determine the ity specifications to the quality of RIs and CDLs. Finally,
underlying RIs. This is considered the “indirect” we discuss the importance of clearly specifying the use
approach [16]. of either RIs and/or CDLs on reports to improve post-
According to the directive on in vitro diagnostic
analytical interpretation.
medical devices of the European Union, diagnostic
manufacturers are now required to supply their clients
with appropriate RIs for use with their assay platforms RI definitions
and reagents [17], and the ISO 15189 standard for clin- RIs are derived from the reference population value dis-
ical laboratory accreditation states that each laboratory tribution, usually the central 95% interval, and describe
should periodically reevaluate its RIs [6]. Despite these a specific population using a minimum sample size of
efforts and requirements, the process of producing the
120, as recommended by the Clinical Laboratory
RIs is complex and the implementation of RIs in most
Standards Institute (CLSI) guideline EP28-A3c [2]. The
clinical laboratories is still incomplete [18]. Furthermore,
reference individuals form the reference sample group
obtaining RIs for pediatric, geriatric, and pregnant pop-
ulations is particularly challenging because of the tech- Table 1. Comparison of CDLs and RIs.
nical difficulty of enrolling a sufficient number of RIs CDLs
reference individuals [19]. Number of values Statistical limits Clinical threshold
The other questions (“Is the patient at risk of a devel- (two values) (one value)
Derivation A biological characteristic A decision regarding a
oping a disease, or is the patient diseased, or worsen- of the unaffected clinical condition
ing?”) are related to clinical decision limits (CDLs), population
Population General population Clinical population
where values above or below the threshold are associ- Based on 95% central interval of Clinical outcome studies,
ated with a significantly higher risk of adverse clinical the reference guidelines and consen-
outcomes or are defined as diagnostic for the presence distribution sus values, ROC curves,
predictive values
of a specific disease [6]. In contrast to the RIs, where Defined by experts Laboratory experts Clinicians and labora-
there are two limits (upper and lower), there is only one tory experts
Most promin- Laboratory experts Clinicians
CDL, which is usually an upper limit. However, accord- ent experts
ing to the likelihood of various clinical situations or dif- Consensus Well-defined [2] Still to be developed
standard
ferent clinical questions, multiple low and high CDLs
CRITICAL REVIEWS IN CLINICAL LABORATORY SCIENCES 3
positives and the understanding of the expected preva- 3. The physiopathological approach involves the use
lence of disease in that particular population. of “critical values” that represent a pathophysio-
logical state with such variance from normal as to
be life-threatening unless prompt action is taken.
Significant figures used in RIs
While many clinical endpoints can be difficult to
The number of significant figures in the reported value define, the endpoint of mortality is clear and,
is defined largely by the analytical confidence [49]. The because it defines the risk of dying or of major
number of significant figures used in a reference limit patient harm (e.g. neonatal hypoglycemia), it
should also be agreed upon when defining common RIs defines a particular set of high risk CDLs often
[50]. For example, is a serum albumin value of 45.4 g/L called “critical values” [55]. Prognostic CDLs for
greater than an upper reference limit of 45 g/L? tumor markers may also belong to this category.
Conversely, if a research study has defined the 97.5th
percentile for the serum albumin reference sample to Regardless of the approach used and the clinical
be 45.4 g/L, should this be rounded down to 45 g/L endpoints defined, CDLs are defined according to an
(slightly increasing the false positive rate) or should it arbitrary risk level.
be rounded up to 46 g/L (ensuring the false positive
rate does not rise above 2.5%)? Diagnostic and staging cutoff values
A diagnostic cutoff is defined by a question such as,
CDLs definitions “When does a patient have diabetes or prediabetes?”
As previously mentioned, RIs relate to studies based on For hemoglobin A1c (HbA1c), the definitions of the
apparently healthy individuals while CDLs are based American Diabetes Association are <39 mmol/mol
mainly on clinical outcome studies (e.g. prospective (<5.7%) for healthy, 39–46 mmol/mol (5.7–6.4%) for
cohort studies, meta-analysis), guidelines and consensus prediabetic, and 48 mmol/mol (6.5%) for diabetic
status [56]. Prediabetes, defined as impaired glucose
values. It is important that these two approaches are
tolerance, impaired fasting glucose, or intermediate
clearly distinguished [51,52].
HbA1c, is of particular importance as a diagnostic cat-
The approaches to identifying CDLs can be catego-
egory because it has been associated with an increased
rized [1]:
risk of cardiovascular disease (CVD) [57], and cardiovas-
cular risk has also been shown to be increased in peo-
1. The Bayesian approach is probably the most evi-
ple with a fasting glucose concentration as low as
dence-based approach to modifying the manage-
5.6 mmol/L or HbA1c of 39 mmol/mol [58].
ment of the patient. Following these criteria, a
While risk may begin at a certain threshold, the def-
value resulting from a diagnostic test that serves
inition of what constitutes a significantly increased risk
to distinguish between two clinical subgroups is
is usually defined arbitrarily by an expert consensus
based on stated assumptions regarding (i) the clin-
group. An example is the definition of gestational dia-
ical sensitivity of the diagnostic test; (ii) the clinical
betes mellitus (GDM) from the International Association
specificity of the diagnostic test; (iii) the relative of Diabetes and Pregnancy Study Groups (IADPSG) [59],
distribution of individuals between the two sub- which was established using the results of the
groups; and (iv) the clinical costs of misclassifica- Hyperglycemia and Adverse Pregnancy Outcome
tion [4]. This concept has been applied to (HAPO) study [60] and which used an odds ratio of
troponins [23,34], where the balance among these 1.75 in selecting the likelihood of complications such
factors had to be considered to maintain the spe- as macrosomia. The prevalence of GDM would have
cificity and sensitivity required for patients pre- been altered if an odds ratio of 2.0 had been chosen
senting with chest pain. instead [61].
2. The epidemiological approach for defining CDLs is Tumor markers represent another group where cut-
based on clinical outcome derived from popula- off values are used instead of RIs. These markers are
tion-based studies and is typically applied to lipid often present in nondiseased people at concentrations
parameters (total cholesterol, low density lipopro- that overlap significantly with those in people with
tein cholesterol [LDL-C], high density lipoprotein malignancies. This typically impedes the general use
cholesterol [HDL-C], etc.) [53] as well as to inter- of tumor markers as a screening tool. For staging
vention-based studies such as diabetes interven- purposes, the International Germ Cell Consensus
tion [54]. Classification represents a tumor marker-based staging
CRITICAL REVIEWS IN CLINICAL LABORATORY SCIENCES 5
system in which three biomarkers contribute to the values/delta change). Reference change values,
staging of men suffering from nonseminomatous germ which can be defined by absolute (± delta) or relative
cell tumors; they are classified into three prognostic (± delta%) means, can help in the interpretation of the
groups, depending on the levels of the markers: good results of serial measurements. The example of absolute
(alpha fetoprotein [AFP] < 1000 ng/mL, human chorionic and relative kinetic changes of cTn in patients with
gonadotrophin [(hCG] < 5000 IU/L, lactate dehydrogen- acute coronary syndrome shows that serial measure-
ase [LDH] < 1.5 upper RL); intermediate (AFP ments may assist in diagnosis and may be used to rule
1000–10000 ng/mL, hCG 5000–50000 IU/L, LDH 1.5–10 out non-ST elevation myocardial infarction [68]. The
upper RL) and poor (AFP >1000 ng/mL, hCG >50000 IU/ prerequisites to calculate delta changes from serial
L, LDH >10 upper RL) [62]. This help in the selection measurements are a well-accepted clinical algorithm
of the appropriate therapy [63]. Interestingly, this classi- with defined time points (e.g. baseline, 3 h, 6 h for cTn)
fication combines two strategies of defining decision
and the knowledge of the intra-individual biological
limits: for AFP and hCG, absolute cutoffs are used,
variation of the measurand (within-individual CV [CVi]).
whereas for LDH, multiples of the upper reference
Although the source of biological variation data is typic-
limit(s) are used.
ally from a healthy reference population, its application
to disease assumes that biological variation is the same
Critical values in chronic disease as in health [69], and this has been
The term “critical value,” also known as critical result, adopted as a surrogate for clinically significant changes.
panic value, or alert value, represents a pathophysio- The choice of statistical model used for clinical monitor-
logical state different from normal that poses a risk to a ing varies according to clinical circumstance [70].
patient’s life unless immediate action is taken [64].
Currently, the use of the term, panic value, is discour-
What is an acceptable risk?
aged, because it suggests emotional stress, and because
it is contrary to the process of communicating informa- The arbitrary setting of the risk level to be flagged, pri-
tion clearly [55]. marily a clinical decision, is based on the balance of
There is an overall risk of mortality in any tertiary set- false positive alarms that are acceptable compared to
ting compared to the general community, but the the clinical outcome benefit gained from true positive
increase in that risk that is associated with laboratory alarms. It is important that the rationale behind any
results can be further used as a flag for clinical action. choice of risk level be explained. Whilst they are primar-
As results deviate from normality, they represent a loss ily clinician-defined, it is essential that laboratory profes-
of homeostasis and the risk of decompensation and, sionals are involved in their definition for several
ultimately, of death. Any result that is outside the RI is reasons. Firstly, the laboratory will need to manage the
associated with a relative increase in the risk of mortal- reporting mechanisms. Secondly, some assays are not
ity [65], but the odds ratio for death varies from analyte standardized, and the risk levels could be method-
to analyte [66]. The perceived risk of death should be
dependent. Thirdly, it is important that results outside
understood, for example, a 25 versus 50% mortality risk
CDLs are not due to preanalytical or analytical artifacts,
in patients who have been admitted in a hospital, and it
and that this potential is managed and communicated
becomes a specifically stated arbitrary setting that can
when necessary.
be agreed upon by clinicians and laboratorians. It is
There are many other points to mention, including
important to note that in some circumstances (e.g.
that the laboratory may report to several clinical set-
hyponatremia), the abnormality may directly reflect the
tings that may have different clinical questions. Gamma
cause of death and the need to focus treatment on cor-
recting the abnormality is implied, while in others (e.g. glutamyl-transferase thresholds can be set to determine
hypernatremia), the abnormality may be an indirect alcohol abstinence or alcohol abuse [71]. Similarly, an
reflection of the cause of death (e.g. dehydration and alanine aminotransferase cutoff could be set to flag
hypovolemia) and correction of the abnormality is sec- everyone in the emergency department with possible
ondary to addressing the underlying mechanisms [67]. paracetamol overdose (e.g. >1000 U/L) [72], everyone in
the blood bank with possible subclinical viral hepatitis
(e.g. >20 U/L) [73], everyone in the lipid clinic with pos-
Reference change values sible fatty liver (e.g. >26 U/L) [74], or everyone in a
The progress of a disease or recovery from it is health screen who may be possibly obese (e.g. >40 U/L)
often reflected by the dynamics of test results (delta [75] (although there are easier ways to define obesity).
6 Y. OZARDA ET AL.
between individuals, it is difficult to achieve the primary important for both RIs and CDLs. Neither universal CDLs
purpose of serum creatinine measurement, which is to (e.g. for lipids and HbA1c) nor common CDLs (e.g. for
gauge renal function. Serum creatinine should now be routine analytes) can be clinically reliable without trace-
routinely translated to an estimation of eGFR using ability and analytical quality standards [94]. When
acknowledged formulae that account for the impact of adopting RIs derived externally, a laboratory can per-
age and gender on muscle mass. While appropriate form a local validation (e.g. 20 healthy people) [95],
serum creatinine RIs could also be translated to eGFR although these procedures are not available for adjust-
RIs [85], the primary purpose for eGFR is to allow appli- ing CDLs and we are reliant on other techniques to con-
cation of the profession-defined CDLs for eGFR that firm method suitability (e.g. external quality assurance).
describe the risk associated with the various stages of
chronic kidney disease. Creatinine reporting is therefore
Postanalytical factors: reporting CDLs and RIs
associated with gender and age-related RIs, while eGFR
reporting is associated with CDLs that take gender and The CLSI guideline EP28-A3c states that “To avoid con-
age into account. fusion, the working group encourages laboratories to
In the case of nutritional factors such as vitamin D, report either decision limits or RIs, but not both, with a
Vitamin B12, and ferritin, where the reference popula- clear indication of which has been used” [2]. The stand-
tion has a high prevalence of deficiency, the use of cor- ard also states that “When decision limits determined
rect RIs is generally problematic because of widespread by national or worldwide consensus exist, these limits,
subclinical deficiency, and these are typically handled as rather than RIs, should be reported,” thus prioritizing
CDLs [86–88]. the preference for CDLs over RIs. Current practice is to
report CDLs for the following measurands: total choles-
terol, LDL-C, HDL-C, non-HDL-cholesterol (non-HDL-C),
Analytical factors
triglycerides, apolipoprotein A (Apo A), apolipoprotein B
In 1999, the IFCC participated in a consensus meeting (Apo B) and HbA1c. However, in the section of the med-
in Stockholm as part of a global effort to define analyt- ical decision limits of the CLSI guideline EP28-A3c, an
ical quality specifications [89]. The hierarchy of example of a report shows that the CDLs for total chol-
approaches to determine analytical quality require- esterol and HDL-C are listed in the column entitled “RI”
ments was headed by clinical outcome studies, but [2]. With many routine laboratory reports, RIs and CDLs
because these were seldom available, the second level are also listed in the “RI” column. This practice disre-
of the hierarchy was strategies supported by clinical gards the basis of the terminology and confuses the dis-
opinion and biological variability. These principles sug- tinction between RIs and CDLs. If this column of the
gested that CDLs based on clinical outcome were super- CLSI guideline EP28-A3c were to be updated and enti-
ior to RIs that were based on biological variation [90]. tled “Reference”, not “RI”, the reference comparator
Fifteen years later in Milan, at a European Federation of could then be either a RI or a CDL. As C-RIDL, we would
Laboratory Medicine (EFLM) meeting, approaches based like to emphasize that the distinction between RIs and
on clinical outcome and biological variation were CDLs should be clear in the report; such a distinction
endorsed [91] and specifically applied to the postanalyt- will have valuable effects on postanalytical quality. A
ical phase, including CDLs and RIs [92]. clearer distinction could also be facilitated with new
Analytical quality affects the reliability of both RIs presentation formats including graphical ele-
and CDLs. The biological variability theory suggests ments [96–98].
that the desirable bias for RI classification takes into The aim of report interpretation is to lead to clinical
account intraindividual and interindividual variability decisions that benefit clinical outcomes, and the basis
[<0.25 (CVi2 þ CVg2)1/2] and that it will prevent an for those decisions usually starts with the rationale for
unacceptable increase in the proportion of healthy flagging an important result.
individuals flagged as outside RIs. Analytical quality will The rationale for flagging elevated cholesterol
similarly affect the application of CDLs, although the related results is based on the two main purposes for
impact is defined not by the statistics of the reference this testing; primary and secondary prevention. In pri-
population distribution but by the clinical risk defini- mary prevention, risk thresholds and lower treatment
tions as well as the prevalence of disease [93]. goals for preventative statin therapy are usually defined
Increasing measurement uncertainty generally causes through epidemiological studies; while in secondary
greater clinical uncertainty; similarly, the impact of prevention, clinical studies have defined even stricter
uncorrected measurement bias will lead to clinical bias. treatment goals. It is also not possible to tailor the
The traceability of method calibration is vitally report to a patient’s individual clinical need if the
8 Y. OZARDA ET AL.
clinical background of the patient has not been shared decision to exempt these men from further screening
with the laboratory. Nevertheless, the issue of variable could be made to allow greater focus on men with
interpretation could be covered with an interpretative higher concentrations.
comment (including a table or link) that details the clin-
ical situation and the agreed-upon corresponding deci-
Concluding remarks
sion thresholds.
Desirable HDL-C values, according to the European The principles for describing RIs and CDLs should be
Guidelines, are 1.03 mmol/L (40 mg/dL) for males kept separate, and this distinction should be clear in
and 1.20 mmol/L (46 mg/dL) for females [99]. HDL-C the laboratory report. We believe that this would greatly
is an example of how physiology, which is mainly a RI improve the postanalytical quality of interpretation and
concern, also impacts the risk point. In the case of HDL- facilitate the national and international adoption of
C, decision limits can be used to categorize people common RIs (including harmonized RIs) and CDLs.
at increased risk (<1.04 mmol/L) or decreased risk The IFCC C-RIDL workplan includes participation in
(>1.55 mmol/L) of coronary artery disease based on the creation of guidelines for the definition of CDLs.
data from large population studies [99]. For example, it The requirements for the creation of CDLs could include
is well-established that the Turkish population has a aspects relating to:
high prevalence of coronary heart disease associated
with some known risk factors [100]. Turks have distinct- 1. the process; that is, the involvement of both clini-
ively low concentrations of HDL-C that are associated cians and laboratory professionals,
with elevated hepatic lipase activity and fasting trigly- 2. the definition; that is, the precise definition of the
ceridemia [101]. Therefore, it would be better to state clinical question (and clinical decision) to
only the population-based RIs in the RI column of the be addressed,
laboratory report, and to state the CDL clearly as a com- 3. the clinical confidence with which the question
ment, for example at the bottom of the report, when a needs to be answered, and finally,
parameter has a well-defined CDL [102]. 4. the mechanisms for the broader implementation
PSA is a good example for contrasting the applica- of CDLs at the national and international level.
tion of RIs and CDLs. The first RI for PSA, defined as
<4.0 lg/L, was based on studies of apparently healthy
men [103]. It was soon found that this upper reference Disclosure statement
limit was not specific in older men, and possibly too No potential conflict of interest was reported by the authors.
specific (and insensitive) in younger men, so age-related
PSA RIs were developed and adopted [104]. The consid-
erable debate around PSA screening was addressed in References
the European Randomized Study of Screening for [1] Ceriotti F, Henny J. Are my laboratory results normal?
Prostate Cancer (ERSPC) [105] and Prostate, Lung, Considerations to be made concerning reference
Colorectal, and Ovarian Cancer Screening Trial (PLCO) intervals and decision limits. EJIFCC. 2008;19:1–9.
[2] CLSI. Defining, Establishing, and Verifying Reference
[106] studies, and the combined results of these studies,
Intervals in the Clinical Laboratory; Approved
which are now considered to agree [107], indicated that Guideline. 3rd ed. CLSI EP28-A3c. Wayne,
PSA testing could prevent death from prostate cancer Pennsylvania: Clinical and Laboratory Standards
in some men. In the ERSPC trial, a uniform cutoff of Institute; 2010.
3.0 lg/L (based on World Health Organization calibra- [3] Keyser JW. The concept of the normal range in clin-
tion) was stated as the threshold, which led to signifi- ical chemistry. Postgrad Med J. 1965;41:443–447.
[4] Sunderman FW. Current concepts of “normal values,”
cant improvements in clinical outcome. Therefore,
“reference values,” and “discrimination values,” in
according to a quality hierarchy prioritizing CDLs based clinical chemistry. Clin Chem. 1975;21:1873–1877.
on clinical outcome over RIs based on healthy individu- [5] Murphy EA, Abbey H. The normal range-a common
als, the cutoff of 3.0 lg/L must be considered at least as misuse. J Chronic Dis. 1967;20:79–88.
equivalent to any RI. Other PSA CDLs can also be con- [6] International Organization for Standardization.
sidered; Epidemiological studies have shown that the Medical laboratories – Requirements for quality and
concentration of PSA at age 60 predicts the lifetime risk competence. ISO 15189:2012. [cited 2018 Jun 9].
Available from: https://www.iso.org/standard/56115.
of metastasis and death from prostate cancer [108],
html
and, although men aged 60 with concentrations below [7] Solberg HE. International Federation of Clinical
the median (1.0 lg/L) may harbor prostate cancer, it is Chemistry (IFCC). Approved recommendation (1986)
unlikely to become life-threatening; thus, the clinical on the theory of reference values. Part 1. The
CRITICAL REVIEWS IN CLINICAL LABORATORY SCIENCES 9
concepts of reference values. J Clin Chem Clin [19] Sikaris K. Physiology and its importance for reference
Biochem. 1987;25:337–342. intervals. Clin Biochem Rev. 2014;35:3–14.
[8] Petit Clerc C, Solberg HE. International Federation of [20] EMA: Guideline on clinical investigation of medicinal
Clinical Chemistry (IFCC). Approved recommendation products in the treatment or prevention of diabetes
(1987) on the theory of reference values. Part 2. mellitus. European Medicines Agency; 2012 [cited
Selection of individual for the production of refer- 2018 June 15]. Available from: http://www.ema.eur-
ence value. J Clin Chem Clin Biochem. 1987;25: opa.eu/docs/en_GB/document_library/Scientific_
337–342. guideline/2012/06/WC500129-256.pdf
[9] Solberg HE, Petit, Clerc C. International Federation of [21] Expert Committee on the Diagnosis Classification of
Clinical Chemistry (IFCC). Approved recommendation Diabetes Mellitus. Report of the expert committee on
on the theory of reference values. Part 3. Preparation the diagnosis and classification of diabetes mellitus.
of individuals and collection of the specimens for the Diabetes Care. 2003;26:S5–S20.
production of reference values. J Clin Chem Clin [22] Zweig MH, Campbell G. Receiver-operating character-
Biochem. 1988;26:593–598. istic (ROC) plots: A fundamental evaluation tool in
[10] Solberg HE, Stamm D. International Federation of clinical medicine. Clin Chem. 1993;39:561–577.
Clinical Chemistry (IFCC). Approved recommendation [23] Kallner A. Bayes' theorem, the ROC diagram and ref-
(1991) on the theory of reference values. Part 4. erence values: Definition and use in clinical diagnosis.
Control of analytical variation in the production, Biochem Med (Zagreb). 2018;28:010101.
transfer and application of reference values. J Clin [24] Reach G. Which threshold to detect hypoglycemia?
Chem Clin Biochem. 1991;29:531–535. Value of receiver-operator curve analysis to find a
[11] Solberg HE. International Federation of Clinical compromise between sensitivity and specificity.
Chemistry (IFCC). Approved recommendation on the Diabetes Care. 2001;24:803–804.
theory of reference values. Part 5. Statistical treat- [25] Greene DN, Tate JR. Establishing consensus-based,
ment of collected reference values. Clin Chem Clin assay specific 99th percentile upper reference limits
to facilitate proper utilization of cardiac troponin
Biochem. 1987;25:645–656.
measurements. Clin Chem Lab Med. 2017;55:
[12] Dybkaer R, Solberg HE. International Federation of
1675–1682.
Clinical Chemistry (IFCC). Approved recommendation
[26] Clerico A, Zaninotto M, Ripoli M, et al.; on the behalf
(1987) on the theory of reference values. Part 6.
of the Study Group on Cardiovascular Risk
Presentation of observed values related to reference
Biomarkers of the Italian Society of Clinical
values. J Clin Chem Clin Biochem. 1987;25:657–662.
Biochemistry (SIBioC). The 99th percentile of refer-
[13] Ozarda Y, Ichihara K, Barth JH, et al. Committee on
ence population for cTnI and cTnT assay: method-
Reference Intervals and Decision Limits (C-RIDL),
ology, pathophysiology and clinical implications. Clin
IFCC. Protocol and standard operating procedures for
Chem Lab Med. 2017;55:1634–1651.
common use in worldwide multicenter study on ref-
[27] Bast RC Jr, Klug TL, St John E, et al. A radioimmuno-
erence values. Clin Chem Lab Med. 2013;51:
assay using a monoclonal antibody to monitor the
1027–1040.
course of epithelial ovarian cancer. N Engl J Med.
[14] Ichihara K, Ozarda Y, Barth JH, et al. Committee on
1983;309:883–887.
Reference Intervals and Decision Limits (C-RIDL), [28] Vuento MH, Stenman UH, Pirhonen JP, et al.
IFCC. A global multicentre study on reference values: Significance of a single CA 125 assay combined with
1. Assessment of methods for derivation and com- ultrasound in the early detection of ovarian and
parison of reference intervals. Clin Chim Acta. 2017; endometrial cancer. Gynecol Oncol. 1997;64:141–146.
467:70–82. [29] Ridker PM, Glynn RJ, Hennekens CH. C-reactive pro-
[15] Ichihara K, Ozarda Y, Barth JH, et al. Committee on tein adds to the predictive value of total and HDL
Reference Intervals and Decision Limits (C-RIDL), cholesterol in determining risk of first myocardial
IFCC. A global multicentre study on reference values: infarction. Circulation. 1998;97:2007–2011.
2. Exploration of sources of variation across the [30] Olson F, Engborg J, Grønhøj MH, et al. Association
countries. Clin Chim Acta. 2017;467:83–97. between high-sensitive troponin I and coronary
[16] Baadenhuijsen H, Smit JC. Indirect estimation of clin- artery calcification in a Danish general population.
ical chemical reference Intervals from total hospital Atherosclerosis. 2016;245:88–93.
patient data: application of a modified Bhattacharya [31] Loeb S, Roehl KA, Antenor JA, et al. Baseline pros-
procedure. J Clin Chem Clin Biochem. 1985;23: tate-specific antigen compared with median pros-
829–839. tate-specific antigen for age group as predictor of
[17] Directive 98/79/EC to the European Parliaments and prostate cancer risk in men younger than 60 years
of the Council 1998-10-27 on in vitro Diagnostic old. Urology. 2006;67:316–320.
Medical Devices. 1998 OJ (L 331), 1. [cited 2018 Jun [32] Harris EK, Boyd JC. On dividing reference data into
15]. Available from: https://ec.europa.eu/growth/sin- subgroups to produce separate reference ranges.
gle-market/european-standards/harmonised-stand- Clin Chem. 1990;36:265–270.
ards/iv-diagnostic-medical-devices_en [33] Sikaris K, McLachlan RI, Kazlauskas R, et al.
[18] Jones GR. Validating common reference intervals in Reproductive hormone reference intervals for healthy
routine laboratories. Clin Chim Acta. 2014;432: fertile young men: evaluation of automated platform
119–121. assays. J Clin Endocrinol Metab. 2005;90:5928–5936.
10 Y. OZARDA ET AL.
[34] Krintus M, Kozinski M, Boudry P, et al. Defining nor- [50] Tate JR, Koerbin G, Adeli K. Opinion paper: Deriving
mality in a European multinational cohort: Critical harmonised reference intervals – global activities.
factors influencing the 99th percentile upper refer- EJIFCC. 2016;27:48–65.
ence limit for high sensitivity cardiac troponin I. Int J [51] Lindstedt G, Tryding N. There is difference between
Cardiol. 2015;187:256–263. decision limits and reference intervals. Reference
[35] Haeckel R, Wosniok W, Arzideh F, et al. Critical com- intervals are based on measurements in healthy indi-
ments to a recent EFLM recommendation for the viduals, decision limits on measurements in patients.
review of reference intervals. Clin Chem Lab Med. Lakartidningen. 2007;104:2076–2079.
2017;55:341–347. [52] Waise A, Price HC. The upper limit of the reference
[36] Zierk J, Arzideh F, Haeckel R, et al. Pediatric reference range for thyroid-stimulating hormone should not be
intervals for alkaline phosphatase. Clin Chem Lab confused with a cut-off to define subclinical hypothy-
Med. 2017;55:102–110. roidism. Ann Clin Biochem. 2009;46:93–98.
[37] Grecu DS, Paulescu E. Quality in post-analytical [53] Abbott RD, Wilson PW, Kannel WB, et al. High density
phase: Indirect reference intervals for erythrocyte lipoprotein cholesterol, total cholesterol screening,
parameters of neonates. Clin Biochem. 2013;46: and myocardial infarction. The Framingham Study.
617–621. Arteriosclerosis 1988;8:207–211.
[38] Kouri T, Kairisto V, Virtanen A, et al. Reference inter- [54] Diabetes Control and Complications Trial Research
vals developed from data for hospitalized patients: Group, Nathan DM, Genuth S, et al. The effect of
Computerized method based on combination of intensive therapy of diabetes on the development
laboratory and diagnostic data. Clin Chem. and progression of long-term complications in
1994;40:2209–2215. insulin-dependent diabetes mellitus. N Engl J Med.
[39] Bhattacharya CG. A simple method of resolution of a 1993;329:977–986.
distribution into Gaussian components. Biometrics. [55] White GH, Campbell CA, Horvath AR. Is this a critical,
1967;23:115–135. panic, alarm, urgent, or markedly abnormal result?
[40] Jones G, Horowitz G. Reference intervals Data mining: Clin Chem. 2014;60:1569–1570.
[56] American Diabetes Association. Diagnosis and classifi-
getting the right paper. Am J Clin Pathol.
cation of diabetes mellitus. Diabetes Care. 2014;37:
2015;144:526–527.
S81–S90.
[41] Jones G, Haeckel R, Loh TP, et al. Indirect methods
[57] Geng J, Zhang Y, Wang B, et al. Glycosylated haemo-
for reference interval determination – review and
globin levels and clinical outcomes in nondiabetic
recommendations. Clin Chem Lab Med. 2018. DOI:
patients with coronary artery disease. Medicine.
10.1515/cclm-2018-0073
2017;96:e6784–e6786.
[42] Ceriotti F. Prerequisites for use of common reference
[58] Selvin E, Steffes MW, Zhu H, et al. Glycated hemoglo-
intervals. Clin Biochem Rev. 2007;28:115–121.
bin, diabetes, and cardiovascular risk in nondiabetic
[43] Colantonio DA, Kyriakopoulou L, Chan MK, et al.
adults. N Engl J Med. 2010;362:800–811.
Closing the gaps in pediatric laboratory reference
[59] International Association of Diabetes and Pregnancy
intervals: a CALIPER database of 40 biochemical
Study Groups Consensus Panel, Metzger BE, Gabbe
markers in a healthy and multiethnic population of SG, Persson B. International association of diabetes
children. Clin Chem. 2012;58:854–868. and pregnancy study groups recommendations on
[44] Adeli K, Raizman JE, Chen Y, et al. Complex biological the diagnosis and classification of hyperglycemia in
profile of hematologic markers across pediatric, adult, pregnancy. Diabetes Care. 2010;33:676–682.
and geriatric ages: Establishment of robust pediatric [60] HAPO Study Cooperative Research Group.
and adult reference intervals on the basis of the Hyperglycemia and Adverse Pregnancy Outcome
Canadian Health Measures Survey. Clin Chem. (HAPO) Study: associations with neonatal anthropo-
2015;61:1075–1086. metrics. Diabetes. 2009;58:453–459.
[45] Hilsted L, Rustad P, Aksglaede L, et al. [61] Metzger BE, Gabbe SG, Persson B, et al. International
Recommended Nordic paediatric reference intervals Association of Diabetes & Pregnancy Study Groups
for 21 common biochemical properties. Scand J Clin (IADPSG) Consensus Panel Writing Group and the
Lab Invest. 2013;73:1. 9. Hyperglycemia & Adverse Pregnancy Outcome (HAPO)
[46] Berg J. The UK Pathology Harmony initiative; The Study Steering Committee. The diagnosis of gesta-
foundation of a global model. Clin Chim Acta. tional diabetes mellitus: new paradigms or status quo?
2014;432:22–26. J Matern Fetal Neonatal Med. 2012;25:2564–2569.
[47] Tate JR, Sikaris KA, Jones GR, et al. and paediatric ref- [62] International Germ Cell Cancer Collaborative Group.
erence intervals in Australia and New Zealand: An International Germ Cell Consensus Classification: A
evidence-based approach for establishing. A First prognostic factor-based staging system for metastatic
Panel of Chemistry Analytes. Clin Biochem Rev. germ cell cancers. J Clin Oncol. 1997;15:594–603.
2014;35:213–235. [63] von Eyben FE. Laboratory markers and germ cell
[48] Koerbin G, Tate JR. Harmonising adult reference tumors. Crit Rev Clin Lab Sci. 2003;40:377–427.
intervals in Australia and New Zealand – the continu- [64] Campbell C, Caldwell G, Coates P, et al. Consensus
ing story. Clin Biochem Rev. 2016;37:121–129. statement for the management and communication
[49] Hawkins RC, Johnson RN. The significance of signifi- of high risk laboratory results. Clin Biochem Rev.
cant figures. Clin Chem. 1990;36:824. 2015;36:97–105.
CRITICAL REVIEWS IN CLINICAL LABORATORY SCIENCES 11
[65] Sikaris KA, Martin A, Guerin MD. Relationship [79] Marwaha RK, Tandon N, Garg MK, et al. Normative
between reference intervals and mortality-based ref- data of body fat mass and its distribution as assessed
erence ranges. Clin Biochem Rev. 1991;12:S81. by DXA in Indian adult population. J Clin Densitom.
[66] Asadollahi K, Hastings IM, Beeching NJ, et al. 2014;17:136–142.
Laboratory risk factors for hospital mortality in [80] Nordestgaard BG, Langsted A, Mora S, et al.
acutely admitted patients. QJM. 2007;100:501–507. European Atherosclerosis Society (EAS) and the
[67] Whelan B, Bennett K, O'Riordan D, et al. Serum European Federation of Clinical Chemistry and
sodium as a risk factor for in-hospital mortality in Laboratory Medicine (EFLM) joint consensus initiative.
acute unselected general medical patients. QJM Fasting is not routinely required for determination of
2008;102:175–182. a lipid profile: clinical and laboratory implications
[68] Mueller M, Biener M, Vafaie M, et al. Absolute and including flagging at desirable concentration cut-
relative kinetic changes of high-sensitivity cardiac points-a joint consensus statement from the
troponin T in acute coronary syndrome and in European Atherosclerosis Society and European
patients with increased troponin in the absence of Federation of Clinical Chemistry and Laboratory
acute coronary syndrome. Clin Chem. 2012;58: Medicine. Eur Heart J. 2016;37:1944–1958.
209–218. [81] Daly N, Turner MJ. Laboratory diagnosis of gesta-
[69] Ricos C, Iglesias N, Garcıa-Lario JV, et al. Within-sub- tional diabetes mellitus. BJOG. 2016;123:1430–1433.
ject biological variation in disease: collated data and [82] Devgun MS, Chan MK, El-Nujumi AM, et al. Clinical
clinical consequences. Ann Clin Biochem. 2007;44: decision limits for interpretation of direct bilirubin–a
343–352. CALIPER study of healthy multiethnic children and
[70] Stevens RJ, Oke J, Perera R. Statistical models for the case report reviews. Clin Biochem. 2015;48:93–96.
control phase of clinical monitoring. Stat Methods [83] Rodger RS, Laker MF, Fletcher K, et al. Factors influ-
Med Res. 2010;19:394–414. encing normal reference intervals for creatinine, urea,
[71] Balldin J, Berggren U, Berglund K, et al. Gamma-glu- and electrolytes in plasma, as measured with a
tamyltransferase in alcohol use disorders: Beckman Astra 8 Analyzer. Clin Chem. 1985;31:
Modification of decision limits in relation to treat- 292–295.
ment goals? Scand J Clin Lab Invest. 2010;70:71–74. [84] Huang M, Yang JJ, Yang JJ, et al. Reference intervals
[72] Levine M, O’Connor AD, Padilla-Jones A, et al. for serum creatinine levels in the healthy geriatric
population. Clin Biochem. 2013;46:1419–1422.
Comparison of prothrombin time and aspartate ami-
[85] Pottel H, Delanaye P, Weekers L, et al. Age-depend-
notransferase in predicting hepatotoxicity after acet-
ent reference intervals for estimated and measured
aminophen overdose. J Med Toxicol. 2016;12:
glomerular filtration rate. Clin Kidney J. 2017;10:
100–106.
545–551.
[73] Assy N, Beniashvili Z, Djibre A, et al. Lower baseline
[86] Nowson CA, McGrath JJ, Ebeling PR, et al. A Position
ALT cut-off values and HBV DNA levels better differ-
Statement. Med J Aust. 2012;199:686–687.
entiate HBeAg- chronic hepatitis B patients from
[87] Aparicio-Ugarriza R, Palacios G, Alder M, et al. A
inactive chronic carriers. World J Gastroenterol.
review of the cut-off points for the diagnosis of vita-
2009;15:3025–3031.
min B12 deficiency in the general population. Clin
[74] Chang Y, Ryu S, Sung E, et al. Higher concentrations
Chem Lab Med. 2015;53:1149–1159.
of alanine aminotransferase within the reference [88] Daru J, Colman K, Stanworth SJ, et al. Serum ferritin
interval predict nonalcoholic fatty liver disease. Clin as an indicator of iron status: what do we need to
Chem. 2007;53:686–692. know? Am J Clin Nutr. 2017;106:1634S–1639S.
[75] Koerbin G, Cavanaugh JA, Potter JM, et al. 'Aussie [89] Fraser CG, Kallner A, Kenny D, et al. Introduction: strat-
normals': an a priori study to develop clinical chemis- egies to set global quality specifications in laboratory
try reference intervals in a healthy Australian popula- medicine. Scand J Clin Lab Invest. 1999;59:477–478.
tion. Pathology 2015;47:138–144. [90] Sikaris KA. Application of the Stockholm hierarchy to
[76] Plebani M. Errors in clinical laboratories or errors in defining the quality of reference intervals and clinical
laboratory medicine? Clin Chem Lab Med. decision limits. Clin Biochem Rev. 2012;33:141–148.
2006;44:750–759. [91] Sandberg S, Fraser CG, Horvath AR, et al. Defining ana-
[77] Arseneau E, Balion CM. Statistical methods used in lytical performance specifications: Consensus Statement
the calculation of geriatric reference intervals: a sys- from the 1st Strategic Conference of the European
tematic review. Clin Chem Lab Med. 2016;54: Federation of Clinical Chemistry and Laboratory
377–388. Medicine. Clin Chem Lab Med. 2015;53:833–835.
[78] Alberti KGMM, Eckel RH, Grundy SM, et al. [92] Sikaris K. Performance criteria of the post-analytical
Harmonizing the metabolic syndrome: a joint interim phase. Clin Chem Lab Med. 2015;53:949–958.
statement of the International Diabetes Federation [93] Petersen PH, Jensen EA, Brandslund I. Analytical
Task Force on Epidemiology and Prevention; National performance, reference values and decision limits.
Heart Lunch and Blood Institute; American Heart A need to differentiate between reference intervals
Association; World Heart Federation; International and decision limits and to define analytical quality
Atherosclerosis Society; and International Association specifications. Clin Chem Lab Med. 2011;50:819–831.
for the Study of Obesity. Circulation. 2009;120: [94] Petersen PH, Klee GG. Influence of analytical bias and
1640–1645. imprecision on the number of false positive results
12 Y. OZARDA ET AL.