Blue Dye Test
Blue Dye Test
Blue Dye Test
DOI 10.1007/s00455-016-9737-3
REVIEW ARTICLE
Received: 28 April 2016 / Accepted: 21 July 2016 / Published online: 16 August 2016
Springer Science+Business Media New York 2016
Abstract Oropharyngeal aspiration (OPA) is a common aspiration in patients with tracheostomy, using a stan-
occurrence in patients with tracheostomy. The modified dardised and reliable procedure. Outcomes from such
Evans blue dye test (MEBDT) is an easily administered studies will update the current level of evidence in relation
bedside procedure for the assessment of tracheostomised to the MEBDT and consequently define best clinical
patients. However, studies evaluating the diagnostic accu- practice.
racy of the MEBDT reach conflicting results. Therefore,
we conducted a systematic review to determine the overall Keywords Deglutition disorders Oropharyngeal
accuracy of the MEBDT in detecting OPA in adults with aspiration Modified Evans blue dye test Diagnostic
tracheostomy. The search strategy incorporated searching accuracy Tracheostomy
electronic databases, checking reference lists and citations
and retrieving unpublished data. Data of primary studies
were extracted and examined by three independent Introduction
reviewers. The assessment of the methodological quality of
included studies was performed using the QUADAS-2 tool. Within the last decade, the number of tracheostomy tube
Six studies met the inclusion criteria for this systematic placements has drastically increased and the insertion of a
review. The studies presented significant disparities in tracheostomy has become a frequently performed proce-
study design and patient characteristics. Furthermore, high dure in intensive care medicine [13]. Reasons include
discrepancies in the administration of MEBDT across advances in critical care medicine, such as the development
studies were noted. Therefore, a meta-analysis was not of less invasive tracheostomy techniques, and improved
considered appropriate. Sensitivity estimates varied widely management of critically ill patients as well as a growing
across the studies (3895 %), indicating that the MEBDT elderly population [4, 5]. Different manifestations of
is unreliable in detecting OPA. However, the studies swallowing difficulties have been reported in combination
emerge with overall high specificity values, ranging from with the presence of a tracheostomy tube [6, 7]. While it is
79 to 100 %. This true negative rate suggests that the recognised that oropharyngeal aspiration (OPA) frequently
MEBDT correctly identifies patients without OPA. This occurs in patients with long-term artificial airways, cur-
review highlights the need for further research studies rently the literature lacks clinical evidence of a causal
assessing the accuracy of the MEBDT in detecting relationship between tracheostomy and aspiration [8]. An
early diagnosis is therefore crucial to enable immediate
management as well as accurate intervention. The restric-
& Sibylle Bechet ted availability and the need of specialised healthcare
bechets@tcd.ie
practitioners complicate or even prevent the use of instru-
1
Department of Clinical Speech and Language Studies, Trinity mental assessment in evaluating deglutition dysfunction of
College Dublin, 7-9 South Leinster Street, Dublin 2, Ireland tracheostomised patients [9]. Thus, clinical practice would
2
Department of Speech and Language Therapy, Tallaght highly benefit from an easily administered and accurate
Hospital, Dublin 22, Ireland screening tool for aspiration in tracheostomised patients.
123
722 S. Bechet et al.: Diagnostic Accuracy of the Modified Evans Blue Dye Test in Detecting
The modified Evans blue dye test (MEBDT) is a recom- Search Strategy
mended bedside procedure for the evaluation of deglutition
and aspiration in tracheostomised patients [10, 11] and The search strategy for identification of studies incorporated
involves mixing blue dye with water or semisolid food. The searching eight different electronic databases (PubMed,
presence of blue dye in or around the tracheostomy tube CINAHL, Embase, ScienceDirect, Web of Science, Psy-
indicates a possible aspiration. cINFO, LILACS, ProQuest Nursing and Allied Health
However, primary studies assessing the diagnostic accu- Source, ProQuest Dissertation & Theses). Databases were
racy (DA) of the MEBDT reach conflicting results. Current sought from October 2014 to April 2016. A preliminary
research lacks clear and reliable results, which could be used search in the databases PubMed and CINAHL was con-
as a basis for clinical practice. Despite a lack of strong evi- ducted to determine the relevant indexing terms. Because of
dence of its accuracy, the MEBDT is used in clinical practice the paucity of studies assessing the DA of the blue dye test,
to diagnose deglutition disorders underlying various dis- the electronic database search was performed using only the
eases. A survey on clinical consistency among SLTs in the index test as key search term. After this initial search, the
management of tracheostomies indicates that out of the 64 reference standards and target condition served as inclusion
participants, 45 % of the SLTs reported having used the criteria in the screening process of the identified records.
MEBDT in their clinical practice [12]. To date, no systematic Furthermore, the search strategy incorporated scanning
review identifying and summarising the findings of all rel- reference lists and citations of relevant studies as well as
evant primary studies and thereby making the available retrieving unpublished data for the purposes of minimising
evidence accessible to health care practitioners has been publication bias [16]. In addition, a search for ongoing studies
conducted. The presence of conflicting evidence and the lack assessing the diagnostic accuracy of the MEBDT was carried
of studies making a strong impact on clinical practice out. The search process was documented and reported using a
therefore justify the need for an objective analysis of all flow diagram, as recommended by the PRISMA statement [17].
available evidence on the accuracy of the MEBDT.
The aims of this systematic review are to investigate the Data Collection and Quality Assessment
overall DA of the MEBDT in assessing the occurrences of
OPA in adult patients with tracheostomy and consequently An initial screening on the basis of title and abstract of all
define the implications of the findings for research and articles generated by the literature search allowed to
clinical practice. exclude studies that were clearly not meeting the inclusion
criteria. Studies that appeared to meet the inclusion criteria
were assessed for eligibility, and data extraction and
Methods analysis was undertaken by four independent reviewers
(SB, FH, OG and MW). Disagreements were discussed and
Study Selection resolved by consensus. Data for each included study were
recorded on a standard data extraction form. The following
The index test assessed within the scope of this review was items were extracted: (1) publication details (title, authors,
the MEBDT as described by Thompson-Henry and Brad- country where the study was conducted; (2) study design
dock [13]. The chosen reference standard tests were the (prospective or retrospective); (3) patient characteristics (n
videofluoroscopy (VFSS) and fiberoptic endoscopic eval- included; population type, mean age); (4) TP, FP, TN and
uation of swallowing (FEES), as both assessment methods FN from the individual studies; (5) index test (protocol and
are widely used in clinical practice and show good con- type of blue dye used); (6) reference standard tests and time
cordance regarding laryngeal aspiration [14, 15]. All types interval between the latter and the index test; (7) follow-up
of studies assessing the DA of MEBDT against VFSS or duration and reported adverse effects of the blue dye. In
FEES were included, regardless of their publication status. addition, the Standards for the Reporting of Diagnostic
No restrictions were made regarding the data-collection Accuracy Studies (STARD) was used as a checklist for the
design, including both retrospective and prospective stud- reporting of DTA studies [18].
ies. Inclusion criteria comprised tracheostomised adults The risk of bias was evaluated using the revised quality
([18 years) with diagnosed or suspected dysphagia, with- assessment of diagnostic accuracy studies-2 tool [19, 20].
out restrictions concerning the underlying medical cause of Each record was evaluated both in terms of the risk of bias
the tracheostomy. Studies were excluded if (1) they did not and of concerns regarding the applicability of the findings.
provide sufficient data for calculating a 2 9 2 contingency Results of the methodological quality assessment were
table; (2) it was impossible to retrieve data concerning the managed on the Cochrane Review writing RevMan soft-
relevant participant group in case of a mixed population ware [21], and a methodological quality graph was con-
(adults and paediatrics). structed for all the included studies.
123
S. Bechet et al.: Diagnostic Accuracy of the Modified Evans Blue Dye Test in Detecting 723
Statistical Analysis and Data Synthesis identified through the searching process, 6 studies met the
eligibility criteria. Table 1 lists the characteristics of the
The statistical analysis of the data was carried out using the included studies. An overview of the methodological
RevMan software [21]. The type of data was binary, with quality of the included studies is presented graphically in
either positive or negative reporting of the target condition. Figs. 2 and 3. The highest risk of bias involves the patient
The following statistical measures provided in the primary selection, followed by the domain flow and timing. In
study were re-calculated using the contingency table: sen- general, all studies presented low applicability concerns in
sitivity, specificity, predictive values, likelihood ratios and the patient selection and their choice of reference standard.
diagnostic odds ratios. The data of each reference standard However, the applicability concerns were greater with
were subsequently analysed and presented separately. Two regard to the index test, as the lack of information on the
forms of graphical display were used to provide an illustrated MEBDT protocol in some studies limited the transparency
overview of the estimates of sensitivity and specificity of the and consequently their applicability.
primary studies: summary ROC plots and forest plots. The analysis of the methodological quality by means of
the QUADAS-2 tool shows that the methodology used in the
study by Thompson-Henry and Braddock [13] is open to
Results question. The small sample size (n = 5), the poorly articu-
lated inclusion and exclusion criteria as well as the lack of
Characteristics and Methodological Quality information on the subject selection largely reduce the power
of Studies of the studys findings. In addition, the use of two different
reference standard procedures and the lack of consistency in
Figure 1 shows the flow of the literature through the search their use limit the trustworthiness of these findings. Infer-
and screening process. Out of 39 different records ences made during the study were based on two events, with a
Fig. 1 Flow diagram showing
the process of selection of
records and studies for this
review
123
724 S. Bechet et al.: Diagnostic Accuracy of the Modified Evans Blue Dye Test in Detecting
Brady et al. [23] 21 Prospective Convenience FEES Pureed and solid Simultaneous procedures
consistencies, ice chips
Donzelli et al. [24] 15 Prospective Consecutive FEES Not specified Simultaneous procedures
ONeill-Pirozzi et al. 37 Prospective Unreported MBS Liquid consistencies: thin Simultaneous procedures
[22] liquid; thick nectar;
saliva
Pureed solid consistencies
Peruzzi et al. [8] 20 Prospective Consecutive VFSS Liquid consistencies Consecutive procedures
(water) (immediate)
Thompson-Henry 5 Retrospective Case study VFSS & FEES Liquid and semisolid Consecutive procedures
and Braddock [13] consistencies (422 days)
Winkl-maier et al. 30 Prospective Consecutive FEES Liquid consistencies (water, Consecutive procedures
[25] artificial saliva) (immediate)
Fig. 2 Risk of bias and applicability concerns across included studies as per review authors judgement for each domain presented as
percentages
123
S. Bechet et al.: Diagnostic Accuracy of the Modified Evans Blue Dye Test in Detecting 725
0.480331 (0.2736
0.615385 (0.4004
overview of the statistical measures of the MEBDT com-
0.8433)
0.9458)
sample sizes of the primary studies reduce the representa-
tivity of the calculated prevalence. Sensitivity and speci-
ficity estimates of the primary studies were highly variable
2.992059 (1.3612
and ranged from 38 to 62 % and from 79 to 100 %,
LR? (95 % CI)
0.466667 (0.2228
in Fig. 5.
The above three studies investigated and compared the
0.8746)
0.7258)
1.00 (0.4629
0.8369)
1.00 (0.56091.00)
0.793103 (0.5974
Spec (95 % CI)
Discussion
0.619048 (0.3869
0.384615 (0.1513
Sens (95 % CI)
0.6772)
20
ded studies.
ONeill-Pirozzi
123
726 S. Bechet et al.: Diagnostic Accuracy of the Modified Evans Blue Dye Test in Detecting
Fig. 4 Coupled forest plot of the estimates of sensitivity and specificity in VFSS studies. TP true positive, FP false positive, FN false negative,
TN true negative
consistency of the administered boluses as well as in the Preliminary evidence emerging from this review sug-
nature and amount of blue dye used to tint the test material. gests that the MEBDT was generally better at excluding
These discrepancies may account for the high variability in OPA, with all studies reporting higher specificity values.
the reported accuracy measures, which consequently makes OPA-positive findings as assessed by the MEBDT-
a comparison of the studies findings difficult. Considering screening procedure thus provide an accurate basis for
the paucity of primary studies assessing the MEBDT and diagnosis, as the patient passed the exclusion test. Nev-
the lack of consensus regarding their sensitivity and ertheless, it is important to stress that all studies reported
specificity values, there is a definite need for further low sensitivity values, indicating that the MEBDT is
research in that area. It is therefore essential for further associated with potential false negative results. As a result,
research to provide large and well-designed primary diag- clinicians are not advised to use the MEBDT in order to
nostic accuracy studies using a standardised MEBDT rule-in OPA. However, the paucity of primary studies
protocol in order to yield generalizable DA measures. investigating the MEBDTs accuracy and their conflicting
123
S. Bechet et al.: Diagnostic Accuracy of the Modified Evans Blue Dye Test in Detecting 727
0.047619 (0.00700.32245)
findings fail to make a definite statement about the relia-
0.60 (0.396920.90699)
0.50 (0.2500490.9998)
bility of the MEBDT as a screening tool. Nevertheless, the
use of a colouring agent might be useful as part of a
0.70 (0.5044210.845872)
[29, 30].
123
728 S. Bechet et al.: Diagnostic Accuracy of the Modified Evans Blue Dye Test in Detecting
Fig. 6 Coupled forest plot of the estimates of sensitivity and specificity in FEES studies. TP true positive, FP false positive, FN false negative,
TN true negative
123
S. Bechet et al.: Diagnostic Accuracy of the Modified Evans Blue Dye Test in Detecting 729
123