LT033 PDF
LT033 PDF
LT033 PDF
Q
Q RIQAS Explained
To develop interlaboratory comparability which allows standardisation of diagnostic testing. EQA measures a laboratory's
accuracy using 'blind' samples that are analysed as if they were patient samples. Results are returned to the scheme organiser
for statistical analysis. Laboratories receive a report comparing their individual performance against other participants in the
programme. EQA has a number of functions:
Participation in an EQA scheme will help produce reliable and accurate reporting of patient results. Quality results will reduce
time and labour costs, and most importantly provide accurate patient diagnosis and treatment.
RIQAS Support
RIQAS Programmes
• Ammonia/Ethanol • Immunosuppressant
• Anti-TSH Receptor • Lipid
• Blood Gas • Liquid Cardiac
• BNP • Maternal Screening
• Cardiac • Serology Epstein Barr Virus (EBV)
• Cerebrospinal Fluid (CSF) • Serology (HIV/Hepatitis)
• Clinical Chemistry • Serology (Syphilis)
• Coagulation • Serology (ToRCH)
• CYFRA 21-1 • Specific Proteins
• ESR • Sweat Testing
• Glycated Haemoglobin (HbA1c) • Therapeutic Drugs
• Haematology • Trace Elements in Blood
• Human Urine • Trace Elements in Serum
• Immunoassay • Trace Elements in Urine
• Immunoassay Speciality 1 • Urinalysis
• Immunoassay Speciality 2 • Urine Toxicology
1
EQA
RIQAS is the largest international EQA scheme in the world. It is used by more than
35,000 laboratory participants in 123 countries. 32 programmes are currently available.
Accreditation
UK Performance Surveillance
• Recognised
by the UK National Quality Assurance Advisory Panel
(NQAAP) for Clinical Pathology
• Recognised
by the Joint Working Group on Quality Assurance
(JWG QA)
RIQAS Facts
2
Features and Benefits
RIQAS samples are custom-manufactured to be both stable and similar to human samples.
• A high level of participation ensures a large database of results and analytical methods, therefore increasing statistical validity.
• H
uman samples free from interfering preservatives increase confidence that EQA performance mirrors the performance of
patient samples.
• Wide range of parameters covering a broad spectrum of laboratory testing allowing for programme consolidation.
• Regular reports with rapid turnaround, ensuring corrective actions can be taken prior to analysis of subsequent samples.
• Reduced parameter options for selected programmes offer greater flexibility, ensuring suitability for
laboratories of all sizes and budgets.
• Participant certificates provide evidence of participation in a reputable EQA scheme.
3
RIQAS Reports
RIQAS reports are presented in a user-friendly, one page per parameter format. This
allows easy interpretation of your analytical performance.
• S tatistical breakdown by all methods, your method and, where Laboratories can register up to five
applicable, your instrument including running means for the last 10 instruments at no extra cost. Individual
samples. reports for each instrument plus a unique
multi-instrument report are provided.
• C
ompare your instrument group, method group and all methods using
the histogram. The multi-instrument report allows the
comparative performance of each instrument.
• Identify trends, biases and precision problems using the visual charts. Additional sample packs may be ordered as
required.
• The Target Score chart grades your performance in a moving window over
the last 20 samples, including the previous cycle.
PDF Reporting
4
Web-Based Data Transfer
RIQAS.Net offers easy, direct access for the submission of results and retrieval of reports
direct from the RIQAS host server.
5
Participation in RIQAS
2
Participant registers the instruments
1
REGISTER
3
Participant analyses the
sample on the recommended QUALITY CONTROL
5 Participant receives
report by email or post
4
36.000 mg/dl
Participant enters their and reviews to assess
84.800 IU/ml
results via RIQAS.Net or on performance.
132.000 ng/ml
the return sheet and submits
electronically, by fax or post
before the final deadline.
6
Participant receives an end-of-cycle
Certificate of Participation report, a certificate of acceptable
<Name> performance and a certificate of
<Laboratory/Hospital>
participation at the end of the cycle,
provided that more than half results
are returned.
Stephen Doherty
RIQAS Manager
abc
PR-281 APR15
7
Method changes and registration
of additional parameters can be
submitted via RIQAS.Net.
6
Standard Report
1
4
3
7
1 Text Section: Statistics for all methods, your method and instrument group (programme specific).
2 Histogram: Method and instrument comparison.
3 Multi-Method Stat Section: Enables assessment of the performance of each method.
4 Levey-Jennings Chart: Details features of your laboratory’s performance.
5 Target Score: This unique chart provides a numerical index of performance, allowing at-a-glance assessment.
6 %Deviation by Sample: Helps to identify trends and shifts in performance.
7 %Deviation by Concentration: Rapid assessment of concentration related biases.
7
Text Section
The text section summarises the statistical information for each parameter.
2 3 4 5 6 7
9
10
RIQAS performance indicators include
11 SDI, Target Score and %Deviation.
10
12 Acceptable performance criteria:
8
10
SDI < 2
Target score > 50
%Deviation < defined acceptable limits
13
14
1 Report is presented in your chosen unit. 7 After statistical reduction, some results are excluded.
2 Number of returned results used to generate Mean for Comparison. 8 Ideally this will be your instrument group mean. If N<5 for instrument
group, your method group Mean is selected as Mean for Comparison.
3 Average value of all laboratories’ results.
9 Standard Deviation Index = Your Result - Mean for Comparison
4 Coefficient of Variation. SDPA adjusted
5 Uncertainty associated with the Mean for Comparison. 10 Running Mean average of the last 10 performance indicators is used
to monitor performance over time and concentration range.
Um = 1.25 x SD
11 Target Score - The closer a value is to 120, the better the performance.
√n
6 SDPA = Standard Deviation for Performance Assessment, calculated 12 %Deviation from the Mean for Comparison - the closer the value is to
from the Target Deviation for Performance Assessment (TDPA) and zero, the better the performance.
the Mean for Comparison.
13 Biological Variation stated for information purposes only.
SDPA = TDPA x Mean for Comparison
14 Performance limit set for this parameter.
t-value x 100
8
Histogram
The Bar Graph is intended as a quick visualisation of how your lab’s result compares to
the method mean, instrument mean and all method mean.
2 5
4
3
1 Total of 673 laboratories reported values between 35.96 and 36.63. 4 RIQAS reports show your unit of measurement.
2 58 laboratories reported values between 33.29 and 33.96 in your 5 25 laboratories reported values between 37.96 and 38.62 in your
method group. instrument group.
3 Your Result.
9
Levey-Jennings Chart
SDIs reflect laboratory performance in relation to fit-for-purpose SDPAs and are useful
to monitor performance over time. Acceptable performance is SDI < 2.
8 C
4 5 6
1 Where a result has been returned, the Mean for Comparison for each 4 N = No result returned from your laboratory. No statistics are shown.
sample is indicated at the top of the chart, allowing easy assessment of
concentration related bias:
I: Instrument mean 5 Sample number.
M: Method mean
A: All method mean
2 This line indicates a change in registration details for this parameter. 6 C = Corrected results will be accepted for non-analytical errors.
Corrected results will be accepted up to 4 weeks after the final date
deadline, on application, with evidence of analysis. Late results are only
3 Your SDI (Standard Deviation Index). accepted if there has been a Randox error.
10
Target Score Chart
The Target Score (TS) allows participants to assess their performance at a glance.
The TS relates the %Deviation of your result from the Mean to a Target Deviation
for Performance Assessment (TDPA). TDPAs are set to encourage participants to
achieve and maintain acceptable performance. TDPAs are fit-for-purpose performance
criteria which are set taking guidance from ISO/IEC17043, ISO13528 and IUPAC. Target
Deviations for Performance Assessment are also used to calculate the Standard Deviation
for Performance Assessment (SDPA).
2 Excellent
Good
Acceptable
3 Unacceptable
1 This is the upper deviation limit of performance for this parameter. 2 High score >50 in the lighter shaded area represents
TDPAs are reviewed regularly and deemed fit for purpose by the acceptable, good or excellent performance.
RIQAS Advisory Panel.
3 Heavy shading for values 10 to 50 signifies poor performance.
11
%Deviation by Sample Chart
8 C
1 %Deviation from Mean for Comparison. 3 Acceptable limits of performance. These are defaulted to RIQAS
TDPAs but can be set to e.g. biological variation or regulatory
requirement on request.
2 Plot of Running Mean %Deviations (average of the last 10
%Deviations for the sample indicated).
12
%Deviation by Concentration Chart
This chart enables rapid assessment of concentration related biases. Biases at low or
high concentrations can be easily determined.
1
2
13
Multi-Method Stat Section
This section provides an easy way of assessing the performance of other methods used
to analyse the parameter in question.
14
Summary Page
Located at the back of the RIQAS Report, the Summary Page collates the key information,
allowing participants to review the performance of all parameters at-a-glance.
3 4
2
2.4
5 6 7
1 RMSDI - is the Running Mean of the 10 previous SDIs (if fewer than 3 RM %DEV - Average of the last 10 %DEV for this parameter.
10 results on file, “Too Few” is printed).
4 RMTS - Average of the last 10 Target Scores for this parameter.
2 Red triangle appears when all performance indicators (SDI, %DEV and
TS) exceed acceptable performance, i.e: when 5 Overall RMSDI = average RMSDI for this sample distribution.
SDI > 2
TS < 50 6 Overall RM%DEV = average RM%DEV for this sample distribution.
%DEV > acceptable limits set
7 Overall RMTS = average RMTS for this sample distribution.
15
Urine Toxicology Report
16
Urine Toxicology Report
Screening Section
1
Performance History
5
13 14
6
7
All Methods (Last 10 Samples)
9
15
10
1 Screening Text Section. 7 Total screening results over all your cut-offs for your laboratory’s
method.
2 Screening Results: This chart is a quick visualisation of your
performance over the last 20 samples. A result in the white section 8 Screening results for all cut-offs returned for this sample over all
indicates a correct response. A result in the upper red section indicates methods.
a False Positive response, and a result in the lower red section indicates
9 Total screening results over all cut-offs for all methods.
a False Negative response.
3 Comment section for RIQAS to provide your laboratory with 10 Screening results for other methods using same cut-off as your
additional relevant information regarding this sample, such as spiked laboratory.
metabolite concentration.
11 Performance history for this parameter, based on previous 10 samples.
4 Screening result response categories. All abbreviations indicated at the
bottom of the report page. 12 Performance of your method over all cut-offs for this sample.
Key
TN - true negative TP - true positive FN - false negative 13 Performance history of your method over all cut-offs, based on the
FP - false positive RC - sent for confirmation NT - not tested previous 10 samples.
5 Screening Summary: Your screening result shown in the appropriate 14 Performance of all methods over all cut-offs for this sample.
response category and your cut off for this sample.
15 Performance history of all methods over all cut-offs, based on the
6 Screening results for all cut-offs returned for this sample within your previous 10 samples.
method group.
17
Urine Toxicology Report
Quantitative Section
1
n value of
t-off value of
e was
False Positive
3
5
False Negative
6Total
Cut-off TN TP FN FP RC NT
0 0
1 Quantitative Text Section: Comparison statistics. Caution is needed 5 Running mean SDI = average of last 10 SDIs for this parameter
when the N value is too small to support statistical significance. (If fewer than 10 results, "Too Few" is printed).
Screening Results
1
2 11
12
4 5 6
13
14
15
8 16
10 10
9
17
2 Your method group and categories. 11 All categories (result options) available for this parameter for any
method (dipstick).
3 Results from all methods (dipsticks) returning results in the same
categories as your lab. 12 Your categories (available result options for chosen dipstick and unit).
4 Results from all methods for all available categories. 13 Comments Box.
5 Your Result. 14 All Categories Histogram: a quick visualisation of how your lab’s
result falls into the overall picture for all categories.
6 Performance Statement.
15 Results submitted from a category not applicable to your method.
7 Your Categories Histogram: A quick visualisation of how your lab’s
result falls into the overall picture for your categories. 16 Your categories.
8 Possible reporting categories for your method. 17 Detailed summary of results: This table enables you to see how you
compare to all other results.
9 All available methods for this parameter.
19
Serology: Screening (Qualitative)
Report
Your performance for multiple samples is presented in a convenient single report per
quarterly distribution.
4
3
1 Your qualitative result and chosen method are presented along with 3 Your Result is shown as a black triangle on the category chart
the acceptable result based on an 80% consensus. This consensus will compared to other laboratories in groups:
be at the method level if there are >5 labs in the group or if there are
<5 labs, will be at the all method level. All Methods Your Method
2 Overall Summary shows the number of results for this parameter and 4 Summary shows performance of all the methods used to analyse
sample which are non-reactive, inconclusive or reactive. the parameter.
20
Serology: Screening (Quantitative)
Report
Your performance for multiple samples is presented in a convenient single report per
quarterly distribution.
50
Sample 2
Number of Laboratories
N Mean CV% Um SDPA Exc.
30
10
1 Quantitative statistics for All Methods and Your Method are presented 3 Multi Method Statistics section provides an easy way of assessing the
in your chosen unit along with your result and your performance scores performance of the methods used to analyse the parameter.
(SDI and RMSDI).
2 Your result is presented on the bar graph as a black triangle, showing 4 Levey-Jennings chart - Your SDIs for previous 20 samples.
how you compare to:
21
Quantitative End-of-Cycle Report
The End-of-Cycle Report is sent to all participants at the end of each cycle and provides
a complete summary of statistics. Results can also be compared to the previous cycle.
22
Text Section (End-of-Cycle Report)
The text section summarises the statistical information for all samples.
4 5 6 7 8 9 10 11 12 13 14
15
16
1 Report presented in your chosen unit 15 Cycle average of your performance indicators – Standard Deviation
Index, Target Score and %Deviation
2 Your assay details as of the last sample (Sum of SDIs returned for the
completed cycle)
Cycle Average SDI =
3 RIQAS TDPA and Biological variation (Number of samples returned in cycle)
4 Sample number
(Sum of your Target Scores returned
Cycle Average for the completed cycle)
5 Your results for each sample Target Score =
(Number of samples returned in cycle)
9 SDPA = Standard Deviation for performance assessment 16 Cycle average for Absolute values of the lab’s SDI and %Deviation.
Absolute values show how far a value is from zero regardless of the
sign. This is an indication of the magnitude of accuracy.
10 Uncertainty of Mean for Comparison
(Sum of your Absolute SDIs
returned for the completed cycle)
11 Coefficient of Variation (%) Cycle Average
Absolute SDI =
(Number of samples returned in cycle)
24
Chart Section (End-of-Cycle Report)
1 2
3 4
2 Target Score chart Shows your Target Scores for a full cycle.
25
Current & Previous Cycle
Absolute SDIs (End-of-Cycle Report)
Based on the cycle average absolute SDI, this char t provides a visual representation
of your laboratory’s performance compared to the previous cycle.
2 3 1
5
4
1 Report title - Cycle Average Absolute SDI This shows your performance this cycle compared to the previous cycle.
26
Certificate of Performance
(End-of-Cycle Report)
An End-of-Cycle report will be issued for all registrations. However, the Certificate of
Performance will only be available for parameters where results for at least 50% of
samples in the cycle have been returned. Labs joining after the beginning of the cycle will
only receive the Certificate of Performance if they meet this criteria. Any parameters not
included on the Certificate of Acceptable Performance will be listed on the Notification
of Unacceptable Performance.
2 XX/X
1 3
5 6
5 Parameters List of parameters broken down for which cycle absolute SDI is ≤ 2
Each EQA report should be evaluated and any poor performance investigated. A step
by step approach should be adopted consisting of the following three steps:
1 2 3
Investigate the source of Implement Check the effectiveness of
the problem corrective actions the corrective actions
In order to identify the source of the problem it is useful to be aware of the most common causes of poor EQA
performance. Errors can occur at any stage of the testing process however EQA is most concerned with detecting
analytical errors i.e. errors that occur during the analysis of the sample.
Most analytical errors can be easily divided into three main areas; clerical errors, systematic errors and random errors.
Systematic errors result in inaccurate results that consistently show a positive or negative bias. Random errors on the
other hand affect precision and result in fluctuations in either direction.
The flowchar t (page 30) is designed to help you investigate any apparent poor performance.
It may be possible that, after extensive investigations, the root cause of the poor performance cannot be established.
Poor performance for a single sample could be attributed to random error. If poor performance has been noted for
several samples, a systematic error is the most likely cause and the analytical process should be reviewed.
28
Monitoring EQA Performance
A checklist similar to the one below is extremely useful when investigating poor EQA
performance and may help you to determine the root cause of the problem and initiate
corrective actions.
Laboratory:
Cycle Number: Sample Number:
Analysis Date: Analyte:
Mean for Comparison: Lab Result: SDI: %Dev:
1. Specimen Handling d. R
andom IQC variation on sample analysis date Y N
a. Samples received in good condition Y N e. E rror due to imprecision; check IQC in terms of
b. Samples stored/prepared appropriately Y N %Deviation compared to deviation observed in EQA Y N
2. Clerical 5. Calibration
a. Correct result entered Y N a. Date of last calibration
b. Correct use of decimal point and units Y N b. Calibration frequency acceptable Y N
c. C
alculations, if any, performed correctly c. Last calibration acceptable Y N
(even if automated) Y N
d. C
onversion factors applied to results before submission Y N 6. Instrument
a. D
aily maintenance performed on date of sample analysis Y N
3. Registration and Mean for Comparison b. S pecial maintenance performed prior to sample analysis Y N
a. R
egistered in the correct method/instrument group Y N c. Instrument operated correctly Y N
b. C
hanged method or instrument without advising d. Operator fully trained Y N
RIQAS Y N
d. An obvious bias between method and instrument means b. Reagents within open vial stability Y N
8. EQA sample
4. Internal Quality Control a. Initial value
a. %
Deviation of IQC (at similar conc to that of EQA) on b. Re-run value
sample analysis date acceptable Y N c. Issue observed in previous EQA samples at a similar
b. S hift in IQC in the periods just before and after EQA concentration (check %Deviation by concentration and
sample analysis Y N Levey Jennings charts) Y N
c. Trends in IQC in the periods before and after EQA d. All parameters affected (to the same extent) - possible
sample analysis Y N reconstitution error (check %Deviation on summary pages) Y N
The flow chart below can be used to help identify a possible root cause for poor EQA
performance.
YES NO
YES NO
NO YES
30
Monitoring EQA Performance
A corrective action is an action taken to correct a problem or non-conformance. Some errors can be readily recognised
as simple clerical errors and easily corrected. If there is evidence of systematic or random error however more detailed
corrective actions must be taken.
Systematic Error
In the event of a systematic error the following suggested actions may help to resolve the problem:
Random Error
If all possible causes have been excluded, a single unacceptable result is most likely due to random error. Re-run the
sample, if the result of repeat analysis is acceptable then corrective action is not required. If the issue persists, investigate
possible sources of systematic error.
The effectiveness or impact of any corrective actions taken can be assessed by continuing to monitor analytical
performance over time.
31
RIQAS Programmes
AMMONIA/ETHANOL PROGRAMME+
RQ9164 (2 ml)
2 Parameters
Samples every month, 1 x 12 month cycle, 12 month subscription, liquid ready-to-use samples
Ammonia Ethanol
BNP PROGRAMME+
RQ9165 (1 ml)
1 Parameter
Samples every month, 1 x 12 month cycle, 12 month subscription, liquid ready-to-use samples
BNP*
PURPLE = The only parameters available on RQ9135/a + = Not accredited * = Pilot study ongoing
32
RIQAS Programmes
ESR PROGRAMME+
RQ9163 (4.5 ml)
1 Parameter (ESR)
2 samples per quarterly distribution, 1 x 12 month cycle, 12 months subcription, liquid ready-to-use samples
ESR
Haematocrit (HCT) Mean Cell Haemoglobin Concentration (MCHC) Platelets (PLT) Red Cell Distribution Width (RDW)
Haemoglobin (Hb) Mean Cell Volume (MCV) Plateletcrit (PCT) Total White Blood Cell Count (WBC)
Mean Cell Haemoglobin (MCH) Mean Platelet Volume (MPV) Red Blood Cell Count (RBC)
PURPLE = The only parameters available on RQ9135/a + = Not accredited * = Pilot study ongoing
33
RIQAS Programmes
IMMUNOSUPPRESSANT PROGRAMME+
RQ9159 (2 ml)
4 Parameters
Samples every month, 1 x 12 month cycle, 12 month subscription, lyophilised samples
PURPLE = The only parameters available on RQ9135/a + = Not accredited * = Pilot study ongoing
34
RIQAS Programmes
Chloride Sodium
PURPLE = The only parameters available on RQ9135/a + = Not accredited * = Pilot study ongoing
35
RIQAS Programmes
URINALYSIS PROGRAMME+
RQ9138 (12 ml)
14 Parameters
Samples every 2 months, 1 x 12 month cycle, 12 month subscription, liquid ready-to-use samples
PURPLE = The only parameters available on RQ9135/a + = Not accredited * = Pilot study ongoing
36
QUALITY CONTROL
INTERNATIONAL HEADQUARTERS
Randox Laboratories Ltd, 55 Diamond Road, Crumlin, County Antrim, BT29 4QY, United Kingdom
+44 (0) 28 9442 2413 +44 (0) 28 9445 2912 marketing@randox.com randoxqc.com
abc
mail@riqas.com riqas.net riqas.com
LT033FEB16
Information correct at time of print. Randox Laboratories Ltd is a subsidiary of Randox Holdings Limited a company registered within Northern Ireland with company number N.I. 614690. VAT Registered Number: GB
151 6827 08. Product availability may vary from country to country. Please contact your local Randox representative for information. Products may be for Research Use Only and not for use in diagnostic procedures
in the USA.