Accuracy of Achalasia Quality of Life and Eckardt Scores For Assessment of Clinical Improvement Post Treatment For Achalasia
Accuracy of Achalasia Quality of Life and Eckardt Scores For Assessment of Clinical Improvement Post Treatment For Achalasia
Accuracy of Achalasia Quality of Life and Eckardt Scores For Assessment of Clinical Improvement Post Treatment For Achalasia
DOI: 10.1093/dote/doaa080
Original Article
Samuel Slone,1 Ambuj Kumar,3 John Jacobs,1,2 Vic Velanovich,2,4 Joel E. Richter1,2
1 2
Division of Digestive Diseases and Nutrition Joy McCann Culverhouse Center for Swallowing Disorders
SUMMARY. Achalasia Quality of Life (ASQ) and Eckardt scores are two patient-reported instruments widely
used to assess symptom severity in achalasia patients. ASQ is validated and reliable. Although Eckardt is commonly
used, it has not been rigorously assessed for validity or reliability. This study aims to evaluate (i) the accuracy
of Eckardt and ASQ for assessing improvement post-treatment (predictive validity), (ii) accuracy of Eckardt and
ASQ for assessing improvement post-treatment with pneumatic dilatation (PD) versus surgical myotomy (predictive
validity), and (iii) convergent validity of Eckardt and ASQ tools. Patients with achalasia treated between 2011 and
2018 were eligible. Both instruments were administered by telephone. Treatment failure was determined by the
review of medical records by two clinicians. The predictive ability of ASQ and Eckardt instruments in identifying
treatment successes and failures was determined using receiver operating characteristics analysis and summarized
as area under the curve (AUC). A total of 106 patients met inclusion criteria with 39 PD, 51 Heller myotomy, and
16 per-oral endoscopic myotomy. A review of medical records and esophageal testing revealed 13 failures (12%).
AUC for Eckardt was 0.96 (95% confidence interval [CI] 0.87–0.99] and ASQ 0.97 (95% CI 0.92–0.99). The
Eckardt cutoff 4, and ASQ, cutoff 15, were 94% and 87% accurate in identifying treatment successes versus failures,
respectively. The correlation coefficient between the two tools was 0.85. In conclusions, (i) ASQ and Eckardt scores
are valid and reliable tools to assess symptom severity in achalasia patients, (ii) both instruments accurately classify
treatment successes versus failures, and (iii) the choice of tool should be informed by the physicians and patients’
values and preferences and repeat physiologic testing may be reserved for treatment failures with either instrument
and patients classified, as treatment successes may be spared routine physiologic testing in the long term.
KEY WORDS: achalasia, heller myotomy, pneumatic dilatation, achalasia questionnaires.
Address correspondence to: Joel E. Richter, MD, Professor and Director, Division of Digestive Diseases and Nutrition, Joy McCann
Culverhouse Center for Swallowing Disorders, 12901 Bruce B. Downs Blvd, MDC 72, Tampa, FL 33612, USA. Email: Jrichte1@usf.edu
© The Author(s) 2020. Published by Oxford University Press on behalf of International Society for Diseases of the Esophagus.
All rights reserved. For permissions, please e-mail: journals.permissions@oup.com 1
2 Diseases of the Esophagus
widely used in evaluating the efficacy of achalasia All consecutive achalasia patients who underwent
treatment.6 Because the items chosen were based PD, Heller myotomy (HM), or per-oral endoscopic
on expert opinion, this can be considered a type of myotomy (POEM) for achalasia at the University of
‘face’ validity.7 The scoring system involves questions South Florida between 2011and 2018 were eligible
related to the frequency of common esophageal for inclusion in the study. Patient information was
symptoms usually associated with achalasia including retrieved from an HRM database. Information on
weight loss, dysphagia, regurgitation, and retrosternal demographics (age, gender, body mass index [BMI])
pressure. A score of 0–3 was applied if the symptoms and procedure were collected from electronic medical
never occurred, occasionally, daily, or with each records (EMR). All patients had achalasia diagnosed
meal.3 A score of 0–3 was also given to the degree via HRM according to the Chicago Classification2
of weight loss (Table 1A). A symptom score of 0–1 and TBS.3 Patients were excluded if they were <18
correlates to clinical stage 0, 2–3 to stage I, 4–6 to or >90 years of age, chose not to participate in the
stage II, and > 6 to stage III (3). Both stage 0 and I study, or could not be reached after three phone call
STATISTICAL ANALYSIS
METHODS
Categorical demographic variables were summarized
We performed a cross-sectional analytic study between as rates/percent and continuous as mean/median and
October 16, 2018 and January 17, 2019. The study was standard deviations/interquartile range (IQR). If both
approved by the institutional review board (IRB) at instruments measure patient-perceived symptoms of
the University of South Florida (Pro00034825). achalasia, there should be a correlation. This can be
Accuracy of Achalasia Quality of Life and Eckardt scores 3
Eckardt Questionnaire
Dysphagia Regurgitation Retrosternal pain Weight loss (kg)
ASQ questionnaire
1. How much has achalasia limited the types of food you have been able to eat in the last month?
b. Somewhat limited (I can eat and drink most of the foods that I would like to.)2
c. Moderately/Severely limited (I can eat and drink very few of the foods I would like to.)3
The following is a list of food types that may or may not cause you difficulty in swallowing. Please indicate which of the following types of
foods you are able to swallow without experiencing any problems such as pain or food ‘sticking’ as it goes down. If you are not sure
whether you can swallow a type of food without problems, please make you best guess.
3. Rice
5. How often in the past month have you need to drink water while eating to deal with food caught in your esophagus?
a. Never/Rarely1
b. Sometimes2
6. How often have you experienced pain when eating during the past month?
a. Never1
b. Rarely2
c. Sometimes3
Continued
4 Diseases of the Esophagus
TABLE 1 Continued
7. During the past month, how much of a problem was heartburn (a burning pain behind the lower part of the chest) for you?
a. No problem1
b. Mild problem2
c. Moderate problem3
d. Severe problem4
8. When you sit down to eat a meal, are you bothered by how long it takes you to finish eating?
a. No, it is not at all limiting (My daily activities have not changed.)1
b. Yes, it has limited my lifestyle (it has affected some areas, and I can no longer participate in all activities I want to do.)2
10. How much do you agree with the following statement about how satisfied you are with your health in regard to achalasia?
b. Agree2
d. Disagree4
e. Strongly disagree5
Age (in Gender Chicago Procedure Current symptoms ASQ score Eckardt Evaluation post-initial treatment
years) classification score
68 Female I Pneumatic dilatation Dysphagia, heartburn, weight 28 6 Abnormal timed barium swallow after second procedure;
loss, chest pain myotomy planned
59 Male II Pneumatic dilatation Dysphagia, heartburn 20 6 Abnormal timed barium swallow after initial procedure; no
subsequent follow-up
43 Female I Heller myotomy Dysphagia, regurgitation 18 4 Abnormal timed barium swallow 3 years after initial procedure
65 Male II Heller myotomy Dysphagia 15 4 No follow-up after surgery as moved out of state
80 Female II Heller myotomy Dysphagia, heartburn, weight 15 4 Abnormal timed barium swallow after initial procedure
loss
76 Female II Heller myotomy Dysphagia, weight loss 20 5 Abnormal timed barium swallow, EGD showed stricture at
LES; no response to pneumatic dilatation for incomplete
myotomy
84 Male III Heller myotomy Dysphagia, regurgitation 21 6 Abnormal timed barium swallow after initial procedure;
Incomplete myotomy requiring repeat Heller myotomy after
survey
20 Male II Heller myotomy Dysphagia, regurgitation 19 4 Post-op gastroparesis diagnosed by gastric emptying test
38 Female II Heller myotomy Dysphagia, regurgitation 16 6 No follow-up after initial surgery
63 Female II Heller myotomy Dysphagia, regurgitation, weight 20 7 Paraesophageal hernia causing secondary obstruction
loss
62 Female Unknown Heller myotomy Dysphagia 21 3 EGD with retained food and esophagitis; pneumatic dilatation
performed without relief; subsequent timed barium swallow
abnormal
41 Female II Per-oral endoscopic Dysphagia, regurgitation, weight 27 9 Repeat EGD showed LES stenosis. Did not respond to simple
myotomy loss, heartburn dilatation. Abnormal timed barium swallow, incomplete
myotomy requiring repeat myotomy after initial survey
83 Male III Per-oral Endoscopic Dysphagia, Regurgitation 15 2 Abnormal timed barium swallow after initial procedure
myotomy
TABLE 3 Sensitivity, specificity, accuracy, number needed to diagnose, and misdiagnose associated with a cutoff ≥2–5 for the eckardt and
≥13–17 for the asq questionnaire
ASQ ques- Cut off Value Treatment success Treatment failures Accuracy Number Number Likelihood to be
tionnaire correctly identified correctly identified (%) needed to needed to diagnosed or
(%) (%) diagnose misdiagnose misdiagnosed
A lower number needed to diagnose is associated with better performance of the test and a higher number needed to misdiagnose is associated
with a better performance of the test. For the likelihood to be diagnosed or misdiagnosed, a smaller number means better performance for
the test. Bold numbers represent best cutoff values and results.
correctly identified 78% of successes and 100% of scores to determine the magnitude of change that
failures resulting in number needed to diagnose of the treatments may have afforded; therefore, we are
1.28. Furthermore, a cutoff ≥16 added little and had unable to determine the responsiveness (sensitivity to
a higher misdiagnosis rate for treatment successes. change) of these instruments.
Another novel finding is the direct comparison of
the ASQ questionnaire with the Eckardt tool, which CONCLUSIONS
is important for clinicians and patients to make an
informed choice. The results show that both tools In conclusion, the findings from our study provide
have similar accuracy but with different tradeoffs. The real-world evidence on the accuracy and performance
overall accuracy of the ASQ questionnaire with a ≥ 15 of the Eckardt and ASQ questionnaires. The evidence
cutoff was 87% versus 94% with the Eckardt tool ≥4 provides physicians and patients with a choice of
cutoff. The number needed to misdiagnose (similar tools in assessing post-treatment response and would
to number needed to harm; higher the number better be helpful in promoting shared decision-making.
11 Urbach D R, Tomlinson G A, Harnish J L, Martino R, Dia- 13 Rohof W O, Lei A, Boeckxstaens G E. Esophageal stasis on
mant N E. A measure of disease-specific health-related quality a timed barium esophagogram predicts recurrent symptoms
of life for achalasia. Am J Gastroenterol 2005; 100(8): 1668–76. in patients with long-standing achalasia. Am J Gastroenterol
12 Chrystoja C C, Darling G E, Diamant N E et al. Achalasia- 2013; 108(1):49–55.
specific quality of life after pneumatic dilation or laparoscopic 14 Vaezi M F, Baker M E, Achkar E, Richter J E. Timed barium
Heller myotomy with partial fundoplication: a multicenter, oesophagram: better predictor of long term success after pneu-
randomized clinical trial. Am J Gastroenterol 2016; 111(11): matic dilation in achalasia than symptom assessment. Gut 2002;
1536–45. 50(6): 765.