Original Investigation | Neurology
Association of Noncontrast Computed Tomography and Perfusion Modalities
With Outcomes in Patients Undergoing Late-Window Stroke Thrombectomy
Guilherme B. F. Porto, MD; Ching-Jen Chen, MD; Sami Al Kasab, MD; Muhammed Amir Essibayi, MD; Eyad Almallouhi, MD; Zachary Hubbard, MD; Reda Chalhoub, BS;
Ali Alawieh, MD; Ilko Maier, MD; Marios-Nikos Psychogios, MD; Stacey Q. Wolfe, MD; Pascal Jabbour, MD; Ansaar Rai, MD; Robert M. Starke, MD, MSc; Amir Shaban, MD;
Adam Arthur, MD, MPH; Joon-Tae Kim, MD, PhD; Shinichi Yoshimura, MD, PhD; Jonathan Grossberg, MD; Peter Kan, MD, MPH; Isabel Fragata, MD, PhD;
Adam Polifka, MD; Joshua Osbun, MD; Justin Mascitelli, MD; Michael R. Levitt, MD; Richard Williamson Jr, MD; Daniele G. Romano, MD; Roberto Crosa, MD;
Benjamin Gory, MD; Maxim Mokin, MD, PhD; Kaustubh S. Limaye, MD; Walter Casagrande, MD; Mark Moss, MD; Ramesh Grandhi, MD; Albert Yoo, MD;
Alejandro M. Spiotta, MD; Min S. Park, MD; for the Stroke Thrombectomy and Aneurysm Registry (STAR) Collaborators
Abstract
IMPORTANCE There is substantial controversy with regards to the adequacy and use of noncontrast
head computed tomography (NCCT) for late-window acute ischemic stroke in selecting candidates
for mechanical thrombectomy.
Key Points
Question Do patients undergoing latewindow stroke thrombectomy achieve
similar 90-day outcomes irrespective of
image modality selection?
OBJECTIVE To assess clinical outcomes of patients with acute ischemic stroke presenting in the late
Findings This cohort study enrolled 733
window who underwent mechanical thrombectomy stratified by NCCT admission in comparison
patients in the late window undergoing
with selection by CT perfusion (CTP) and diffusion-weighted imaging (DWI).
thrombectomy: 419 selected with
noncontrast computed tomography
DESIGN, SETTING, AND PARTICIPANTS In this multicenter retrospective cohort study,
(CT); 280, CT perfusion; and 34,
prospectively maintained Stroke Thrombectomy and Aneurysm (STAR) database was used by
diffusion-weighted imaging. After
selecting patients within the late window of acute ischemic stroke and emergent large vessel
adjustments for confounders, there was
occlusion from 2013 to 2021. Patients were selected by NCCT, CTP, and DWI. Admission Alberta
no difference in functional
Stroke Program Early CT Score (ASPECTS) as well as confounding variables were adjusted. Follow-up
independence rates between groups.
duration was 90 days. Data were analyzed from November 2021 to March 2022.
Meaning These findings suggest latewindow stroke thrombectomy patient
EXPOSURES Selection by NCCT, CTP, or DWI.
selection via noncontrast CT is
associated with comparable outcomes
MAIN OUTCOMES AND MEASURES Primary outcome was functional independence (modified
with perfusion modalities.
Rankin scale 0-2) at 90 days.
RESULTS Among 3356 patients, 733 underwent late-window mechanical thrombectomy. The
median (IQR) age was 69 (58-80) years, 392 (53.5%) were female, and 449 (65.1%) were White. A
total of 419 were selected with NCCT, 280 with CTP, and 34 with DWI. Mean (IQR) admission
+ Supplemental content
Author affiliations and article information are
listed at the end of this article.
ASPECTS were comparable among groups (NCCT, 8 [7-9]; CTP, 8 [7-9]; DWI 8, [7-9]; P = .37). There
was no difference in the 90-day rate of functional independence (aOR, 1.00; 95% CI, 0.59-1.71;
P = .99) after adjusting for confounders. Symptomatic intracerebral hemorrhage (NCCT, 34 [8.6%];
CTP, 37 [13.5%]; DWI, 3 [9.1%]; P = .12) and mortality (NCCT, 78 [27.4%]; CTP, 38 [21.1%]; DWI, 7
[29.2%]; P = .29) were similar among groups.
CONCLUSIONS AND RELEVANCE In this cohort study, comparable outcomes were observed in
patients in the late window irrespective of neuroimaging selection criteria. Admission NCCT scan may
triage emergent large vessel occlusion in the late window.
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291
Open Access. This is an open access article distributed under the terms of the CC-BY License.
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
November 11, 2022
1/11
JAMA Network Open | Neurology
Noncontrast Computed Tomography in Late-Window Thrombectomy
Introduction
Rapid restoration of blood flow to intracranial circulation is critical for good outcomes in patients with
acute ischemic stroke (AIS). Multiple randomized clinical trials have demonstrated the role of
mechanical thrombectomy (MT) in patients with anterior circulation emergent large vessel occlusion
(ELVO).1,2 Initially approved for patients within a 6-hour window, the MT therapeutic window has
been extended to 24 hours, with the use of computed tomography perfusion (CTP) and diffusionweighted imaging (DWI) to select patients for MT according to the results of DAWN (DWI or CTP
Assessment with Clinical Mismatch in the Triage of Wake-Up and Late Presenting Strokes Undergoing
Neurointervention with Trevo) and DEFUSE 3 (Diffusion and Perfusion Imaging Evaluation for
Understanding Stroke Evolution) trials.3-6
The assessment of penumbral tissue as well as core infarct has been reported to correlate with
clinical outcomes and therefore assist in selecting appropriate candidates for MT, establishing the
amount of irreversible infarct and potential salvageable tissue.7-9 Patients ideally present with a small
core infarct and a much larger penumbral area; in such cases, timely reperfusion will halt progression
of the infarct and lead to functional recovery of the remaining salvageable tissue. According to the
selection criteria used for the early and late MT trials, patients in early window presentation (0-6
hours) are evaluated for MT candidacy according to a noncontrast computed tomography (NCCT)
scan, yet late-window presentation (6-24 hours) candidacy is usually assessed by advanced imaging
with perfusion studies.4-6,10 Although the use of perfusion imaging helps better identify patients
who are likely to benefit, there is growing evidence showing that relying on perfusion imaging likely
leads to overselection and potentially leads to excluding patients who could benefit from MT.11
Furthermore, advanced imaging is not readily available in all stroke centers. In the late window,
although infarct core and penumbra can be assessed with a variety of imaging modalities, early
ischemic changes can be assessed on NCCT with moderate interrater reliability and estimation of
good outcome using Alberta Stroke Program Early CT Score (ASPECTS).12 The CLEAR study by
Nguyen et al13 demonstrated potential widespread use of NCCT in triaging ELVO in the late window.
Despite these recent data, there is substantial controversy with regards to the adequacy and use of
NCCT for late-window AIS in selecting for candidates for MT.14
The objective of this study was to assess clinical outcomes of patients with AIS presenting in the
late window who underwent MT stratified by NCCT on admission in comparison to selection by CTP
and DWI. We hypothesized that selection of candidacy for MT via NCCT leads to comparable 90-day
outcomes as selection of candidacy for MT via CTP or DWI.
Methods
Prospectively maintained registries of 28 stroke centers in the Stroke Thrombectomy and Aneurysm
(STAR) collaboration were included in this study, approved by each individual institution’s
institutional review board. A waiver of informed consent was granted due to the retrospective nature
of the study and research involving no more than minimal risk due to completely anonymized nature
of the data collection. This report follows the Strengthening the Reporting of Observational Studies
in Epidemiology (STROBE) reporting guideline for cohort studies. The study population consisted of
consecutive patients with stroke who underwent an NCCT head with CT angiogram with or without
CTP or DWI and subsequent MT within the predefined late-window treatment period (beyond 6
hours from last known well) between 2013 and 2021 in comprehensive stroke centers across US,
Europe, Asia, and South America. The study exposure was selection by NCCT, CTP, or DWI. CTP was
selected if the patient underwent NCCT and CTP, and DWI was selected if patient underwent CTP
and DWI. Eligibility criteria consisted of patient selection for the procedure via published criteria for
thrombectomy: National Institutes of Health Stroke Scale (NIHSS) score of 6 or higher, prestroke
modified Rankin scale (mRS) of 0 to 2, anterior circulation large-vessel (internal carotid artery,
middle cerebral artery M1 segment, or middle cerebral artery M2 segment) occlusion, and time from
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
November 11, 2022
2/11
JAMA Network Open | Neurology
Noncontrast Computed Tomography in Late-Window Thrombectomy
time last known well to arterial puncture of 6 to 24 hours.4,5,15 Exclusion criteria included
large-vessel occlusion presentation in early window (0-6 hours from last known well), posterior
circulation large-vessel occlusion, and prestroke mRS 3 to 5. Patients were followed up for 90 days
after thrombectomy. All procedures were performed by experienced interventionalists with
commercially available aspiration catheters and stent retrievers.
Patient demographic characteristics; comorbidities; large vessel occlusion site; ASPECTS on
arrival; admission, discharge, and 90-day NIHSS and mRS; modified thrombolysis in cerebral
infarction recanalization score (successful recanalization 2b/3); symptomatic intracerebral
hemorrhage (sICH); and intravenous thrombolytics use variables were collected for analyses. sICH
was defined using European Cooperative Acute Stroke Study III.16 These variables were collected via
electronic medical record. Race and ethnicity information (Black, Hispanic, White, other) was
collected via electronic medical record. Race and ethnicity were assessed due to known health
disparities in stroke care and outcomes. Imaging was reviewed by each enrolling site. Bias was
reduced by the multicenter source of the data. Study size was obtained by analyzing all-comers in
study enrollment period meeting inclusion criteria.
Primary outcome of the study was functional independence at 90 days (mRS 0-2). The
secondary outcomes included shift analysis toward better outcomes, development of sICH, and
90-day mortality.
Statistical Analysis
All baseline characteristics and outcomes were stratified by imaging modality into 3 groups: NCCT,
CTP, and DWI. Continuous variables were reported as median with the IQR. Continuous variables
were analyzed using student t test and Mann-Whitney U or Wilcoxon rank sum test. Categorical
variables were reported as percentage and analyzed using Pearson χ2 test or Fisher exact test. We
investigated the univariate and multivariable correlations between only functional outcomes as the
primary outcome and variables of interest as covariates, which included sex, age, NIHSS on
admission, ASPECTS, race, prestroke mRS, hypertension, atrial fibrillation, diabetes, hyperlipidemia,
congestive heart failure, previous stroke, smoking history, intravenous thrombolytic, and site of
occlusion. Probability of functional independence (mRS 0-2) at 90 days was estimated using
binomial logistic regression model. Distribution of 90-day mRS score analyses (ordinal shift) were
analyzed using multinomial ordinal logistic regression in which a shift to the value in the lower order
was considered a better outcome. logistic regressions, crude and adjusted odds ratios (ORs) and 95%
CIs were reported for each parameter. P < .05 was considered significant, and all tests were 2-tailed.
Regarding patients with missing values, given that the missing data are not at random due to the
multicenter nature of this study, no imputation was performed. Missing data were dropped out for
each outcome in the analysis. All statistical analyses were performed by JAMOVI open-source R
based statistical software version 2.3 (R Project for Statistical Computing). Data were analyzed from
November 2021 to March 2022.
Results
Baseline Characteristics, Imaging Modalities, Metrics, and Outcomes
A total of 3356 patients in the STAR database were reviewed and 733 (21.8%) met inclusion criteria
of undergoing MT due to an emergent large vessel occlusion in the late window (median [IQR] age 69
[58-80] years; 392 [53.5%] female; 449 [65.1%] White). Of those, 581 patients (79.3%) had
ASPECTS of 6 or greater. Demographic and clinical characteristics of the included participants were
stratified by all-comer candidates for MT in the late window selected by the 3 imaging modalities:
NCCT with angiography (419 [57%]), CTP (280 [38%]), DWI (34 [5%]). Demographic data for the
cohort are described in Table 1.
The median (IQR) age was different among the 3 categories: (NCCT, 68 [57-78] years; CTP, 70
[60-81] years; DWI, 75 [70-84] years; P < .005). There was no difference in median (IQR) ASPECTS
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
November 11, 2022
3/11
JAMA Network Open | Neurology
Noncontrast Computed Tomography in Late-Window Thrombectomy
Table 1. Baseline Characteristics, Metrics, and Outcomes of Patients, According to Imaging Modality Selection
for Thrombectomy
Participants, No. (%)
Characteristics
NCCT
(n = 419)
CTP
(n = 280)
DWI
(n = 34)
Total
(N = 733)
P value
Age, median (IQR), y
68 (57-78)
70 (60-81)
75 (70-84)
69 (59-80)
.005a
NIHSS on admission, median (IQR)
15 (10-19)
14 (8-19)
15 (10-19)
14 (9-19)
.23a
ASPECTS on admission, median (IQR)
8 (7-9)
8 (7-9)
8 (6-10)
8 (7-9)
.37a
Female
226 (53.9)
146 (52.1)
20 (58.8)
392 (53.5)
Male
193 (46.1)
134 (47.9)
14 (41.2)
341 (46.5)
Sex
.73b
Race and ethnicityc
Black
94 (24.8)
29 (10.4)
0
123 (17.8)
Hispanic
12 (3.2)
22 (7.9)
0
34 (4.9)
White
237 (62.5)
207 (74.2)
5 (15.6)
449 (65.1)
Othersd
36 (9.5)
21 (7.5)
27 (84.4)
84 (12.2)
0
319 (76.1)
186 (66.4)
26 (76.5)
531 (72.4)
1
70 (16.7)
67 (23.9)
4 (11.8)
141 (19.2)
2
<.001b
Prestroke mRS
.048b
30 (7.2)
27 (9.6)
4 (11.8)
61 (8.3)
Hypertension
280 (66.8)
212 (75.7)
22 (64.7)
514 (70.1)
.03b
Atrial fibrillation
141 (33.7)
102 (36.4)
15 (44.1)
258 (35.2)
.40b
Diabetes
114 (27.2)
80 (28.6)
8 (23.5)
202 (27.6)
.80b
Hyperlipidemia
187 (44.6)
147 (52.5)
14 (41.2)
348 (47.5)
.09b
Congestive heart failure
39 (11.9)
24 (8.7)
5 (14.7)
68 (10.6)
.33b
Previous stroke
66 (15.8)
49 (17.5)
7 (20.6)
122 (16.6)
.68b
Current
86 (22.2)
59 (22.6)
1 (2.9)
146 (21.4)
Former
77 (19.8)
74 (28.4)
4 (11.8)
155 (22.7)
Smoking history
Never
<.001b
225 (58.0)
128 (49.0)
29 (85.3)
382 (55.9)
59 (14.1)
40 (14.3)
4 (11.8)
103 (14.1)
Internal carotid artery
140 (33.4)
97 (34.6)
9 (26.5)
246 (33.6)
Middle cerebral artery M1
178 (42.5)
137 (48.9)
20 (58.8)
335 (45.7)
Middle cerebral artery M2
101 (24.1)
46 (16.4)
5 (14.7)
152 (20.7)
662
(466-931)
742
(490-1020)
566
(481-796)
682
(475-977)
0-2a
66 (15.8)
30 (10.9)
2 (6.2)
98 (13.5)
2b-3
351 (84.2)
246 (89.1)
30 (93.8)
627.0 (86.5)
5 (2.7)
2 (0.9)
2 (6.1)
9 (2.0)
.09b
At 24 h
10 (5-18)
11 (4-17)
13 (8-15)
11 (5-17)
.80a
At discharge
6 (2-16)
6 (2-12)
6 (4-10)
6 (2-14)
.38c
mRS at discharge, median (IQR)
4 (2-5)
4 (2-5)
4 (2-5)
4 (2-5)
.51a
Length of stay, median (IQR), d
7 (4-10)
7 (4-10)
10 (8-15)
7 (4-10)
.22a
NIHSS at 90 d, median (IQR)
3 (1-8)
2 (0-5)
2 (1-4)
2 (1-7)
.17a
mRS at 90 d, median (IQR)
3 (1-5)
3 (1-5)
4 (2-5)
3 (1-5)
.95a
Intravenous thrombolytic
.92b
Occluded vessel
Onset to puncture time, median (IQR),
min
.06b
.04a
Final thrombolysis in cerebral infarction
Craniectomy
.08b
NIHSS, median (IQR)
Abbreviations: ASPECTS, Alberta Stroke Program Early
CT Score; CTP, computed tomography perfusion; DWI,
diffusion-weighted imaging; mRS, modified Rankin
scale; NCCT, noncontrast head computed tomography;
NIHSS, National Institutes of Health Stroke Scale.
a
Mann-Whitney U or Wilcoxon rank sum test.
b
Pearson χ2 test.
c
Race classifications were self-reported and retrieved
from electronic medical record.
d
Others included American Indian, Asian, Native
Hawaiian or other Pacific Islander.
e
Fisher exact test.
mRS at 90 d
0-2
92 (37.9)
83 (35.3)
9 (34.6)
184 (36.5)
3-6
.83a
151 (62.1)
152 (64.7)
17 (65.4)
320 (63.5)
Symptomatic intracerebral hemorrhage
34 (8.6)
37 (13.5)
3 (9.1)
74 (10.5)
.12e
Mortality at 90 d
78 (27.4)
38 (21.1)
7 (29.2)
123 (25.2)
.29a
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
November 11, 2022
4/11
JAMA Network Open | Neurology
Noncontrast Computed Tomography in Late-Window Thrombectomy
on admission (NCCT, 8 [7-9]; CTP, 8 [7-9]; DWI, 8 [7-9]; P = .37) or median (IQR) NIHSS on admission
(NCCT, 15 [10-19]; CTP, 14 [8-19]; DWI, 15 [10-19]; P = .23). Prestroke functional status was similar
among the 3 groups. There were no differences in comorbidities (hypertension, atrial fibrillation,
diabetes, hyperlipidemia, congestive heart failure, or prior stroke). There were fewer current
smokers in the DWI category (NCCT, 86 [22.2%]; CTP, 59 [22.6%]; DWI, 1 [2.9%]; P < .001). There
was no difference in administration of intravenous thrombolytics or site of large vessel occlusion.
Median (IQR) symptom onset to groin puncture time was lower in DWI (NCCT, 662 minutes
[466-931]; CTP, 742 minutes [490-1020]; DWI, 566 minutes [481-796]; P = .04). There was no
significant difference in successful recanalization rates among groups (NCCT, 351 [84.2%]; CTP, 246
[89.1%]; DWI, 30 [93.8%]; P = .08). The rates of craniotomy, median NIHSS at 24 hours, NIHSS at
discharge, mRS at discharge, length of hospital stay, NIHSS at 90 days, mRS at 90 days, sICH, and
mortality were not statistically different among the 3 imaging cohorts. Functional independence at
90 days was noted in 184 patients (NCCT, 92 [37.9%]; CTP, 83 [35.3%]; DWI, 9 [34.6%]) (Figure).
Symptomatic intracerebral hemorrhage (NCCT, 34 [8.6%]; CTP, 37 [13.5%]; DWI, 3 [9.1%]; P = .12)
and mortality (NCCT, 78 [27.4%]; CTP, 38 [21.1%]; DWI, 7 [29.2%]; P = .29) were similar. Missing data
are available eTable in the Supplement.
Analysis of 90-Day Functional Independence
Univariate and multivariable analyses stratified by functional independence (mRS 0-2) at 90 days for
all-comers in the late window are shown in Table 2. There was no difference in the 90-day rate of
functional independence between NCCT- and CTP-selected patients (aOR, 1.00; 95% CI, 0.59-1.71;
P = .99), or NCCT- and DWI-selected patients (aOR, 1.33; 95% CI, 0.4-4.35; P = .63) after adjusting for
confounders. The following variables were independently associated with good outcome at 90 days:
age (aOR, 0.97; 95% CI, 0.95-0.99; P = .001), NIHSS on admission (aOR, 0.90; 95% CI, 0.86-0.94;
P < .001), ASPECTS (aOR, 1.20; 95% CI, 1.02-1.42; P = .03), prestroke mRS (aOR, 0.13; 95% CI, 0.030.63; P = .01), hypertension (aOR, 0.51; 95% CI, 0.28-0.93; P = .02), diabetes (aOR, 0.57; 95% CI,
0.38-0.87; P = .009), and prior stroke (aOR, 0.58; 95% CI, 0.34-0.98; P = .04).
Figure. Distribution of 90-Day Modified Rankin Scale Score by Imaging Modality
40
Imaging modality
Noncontrast
head computed
tomography
Computed
tomography
perfusion
Diffusionweighted
imaging
Frequency, %
30
20
10
0
0
1
2
3
4
5
Modified Rankin scale score at 90 d
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
6
A 0 on the modified Rankin scale indicates no
disability; 6, death.
November 11, 2022
5/11
JAMA Network Open | Neurology
Noncontrast Computed Tomography in Late-Window Thrombectomy
Analysis of 90-Day Ordinal mRS Shift Toward Better Outcome
Univariate and multivariable analyses of imaging modality, baseline characteristics, and metrics with
90-day ordinal mRS shift toward better outcomes are shown in Table 3. After adjusting for
confounders, there was no difference in 90-day ordinal mRS shift between patients selected by
NCCT vs CTP (aOR, 1.06; 95% CI, 0.7-1.61; P = .77) and NCCT vs DWI (aOR, 1.86; 95% CI, 0.80-4.31;
P = .15). ASPECTS (aOR, 1.15; 95% CI, 1.02-1.30; P = .02) was associated with a significantly higher
odds of a 1-point shift to better outcome. The following variables were associated with significantly
lower odds of a 1-point shift to better outcome: age (aOR, 0.96; 95% CI, 0.94-0.97; P < .001), NIHSS
on admission (aOR, 0.93; 95% CI, 0.90-0.95; P < .001), and higher prestroke mRS (aOR, 0.37; 95%
CI, 0.18-0.76; P = .007).
Discussion
This cohort study found comparable outcomes among patients with anterior circulation large vessel
occlusion presenting in the late window who underwent MT based on NCCT and those who
underwent advanced imaging. We found no difference in 90-day functional independence and no
Table 2. Univariate and Multivariate Predictors of 90-Day Functional Independence
OR (95% CI)
Factor
Univariate analysis
Multivariate analysis
Imaging modality
NCCT
1 [Reference]
1 [Reference]
CTP
0.90 (0.62-1.30)
1.00 (0.59-1.71)
DWI
0.87 (0.37-2.03)
1.33 (0.41-4.35)
Age
0.97 (0.96-0.99)
0.97 (0.95-0.99)
NIHSS on admission
0.88 (0.86-0.91)
0.90 (0.86-0.94)
ASPECTS
1.27 (1.13-1.44)
1.20 (1.02-1.42)
Female sex
1.07 (0.74-1.54)
1.25 (0.75-2.08)
Race and ethnicity
White
1 [Reference]
1 [Reference]
Black
0.58 (0.33-1.01)
0.46 (0.20-1.06)
Hispanic
1.11 (0.46-2.69)
1.27 (0.41-3.98)
Others
0.89 (0.50-1.56)
0.76 (0.31-1.85)
Prestroke mRS
0
1 [Reference]
1 [Reference]
1
0.51 (0.32-0.81)
0.64 (0.34-1.21)
2
0.19 (0.72-0.49)
0.13 (0.03-0.63)
Hypertension
0.54 (0.36-0.80)
0.51 (0.28-0.93)
Atrial fibrillation
0.84 (0.57-1.23)
1.33 (0.74-2.40)
Diabetes
0.57 (0.38-0.87)
0.66 (0.36-1.19)
Hyperlipidemia
1.07 (0.74-1.54)
1.43 (0.84-2.43)
Congestive heart failure
0.81 (0.42-1.54)
0.87 (0.34-2.25)
Previous stroke
0.58 (0.34-0.98)
0.73 (0.35-1.49)
Smoking history
Never
1 [Reference]
1 [Reference]
Current
1.03 (0.63-1.69)
1.01 (0.50-2.01)
Former
1.08 (0.69-1.70)
1.32 (0.70-2.48)
0.74 (0.43-1.30)
0.51 (0.24-1.10)
Internal carotid artery
0.97 (0.65-1.46)
1.05 (0.60-1.85)
Middle cerebral artery M1
1 [Reference]
1 [Reference]
Middle cerebral artery M2
1.27 (0.78-2.06)
0.95 (0.46-1.95)
Intravenous thrombolytic
Site of occlusion
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
Abbreviations: ASPECTS, Alberta Stroke Program Early
CT Score; CTP, computed tomography perfusion; DWI,
diffusion-weighted imaging; mRS, modified Rankin
scale; NCCT, noncontrast head computed tomography;
NIHSS, National Institutes of Health Stroke Scale; OR,
odds ratio.
November 11, 2022
6/11
JAMA Network Open | Neurology
Noncontrast Computed Tomography in Late-Window Thrombectomy
difference in 90-day ordinary mRS shift between NCCT and CTP and NCCT and DWI in a large sample
of 766 patients who underwent MT in the late window. Our findings provide important data
supporting the use of NCCT to triage patients with anterior circulation LVO in the late window. Such
a simplified approach to select patients for MT, particularly given the lack of wide availability of
perfusion studies, could lead not only to shortened treatment times, but also expand the current
guideline indications for MT in the late window in areas where advanced imaging is not available.
These results build on the recently published CLEAR study13 showing similar outcomes among
patients with intracranial internal carotid artery, middle cerebral artery M1 segment, or middle
cerebral artery M2 segment occlusion selected by NCCT compared with perfusion imaging. In the
CLEAR study, 534 patients were selected by NCCT, 752 by CTP, and 318 by magnetic resonance
imaging (MRI). There were no differences in 90-day rates of functional independence between the
NCCT and CTP groups; however, rates were lower in the MRI group in comparison to NCCT.13 Both
DAWN and DEFUSE 33-6 trials used perfusion imaging to select patients for MT. The use of advanced
imaging was meant to select patients who are most likely to benefit from MT. There has been growing
evidence over the past few years showing correlation between NCCT ASPECTS and CTP. A study by
Demeestere et al17 in a cohort of 59 patients who underwent NCCT, CTP, and MRI within 100 minutes
Table 3. Univariate and Multivariate Analysis of Imaging Modality, Baseline Characteristics, and Metrics
With 90-Day Ordinal mRS Score Shift Toward Better Outcomes
OR (95% CI)
Factor
Univariate analysis
Multivariate analysis
Imaging modality
NCCT
1 [Reference]
1 [Reference]
CTP
0.98 (0.72-1.35)
1.06 (0.70-1.61)
DWI
0.90 (0.46-1.78)
1.86 (0.80-4.31)
Age
0.96 (0.95-0.97)
0.96 (0.94-0.97)
NIHSS on admission
0.91 (0.88-0.93)
0.93 (0.90-0.95)
ASPECTS
1.22 (1.11-1.33)
1.15 (1.02-1.30)
Female sex
0.97 (0.69-1.40)
1.21 (0.82-1.77)
Race and ethnicity
White
1 [Reference]
1 [Reference]
Black
0.86 (0.59-1.31)
0.69 (0.39-1.22)
Hispanic
1.79 (0.86-3.78)
1.73 (0.72-4.21)
Others
0.85 (0.54-1.36)
0.55 (0.28-1.09)
Prestroke mRS
0
1 [Reference]
1 [Reference]
1
0.59 (0.40-0.85)
0.70 (0.44-1.12)
2
0.33 (0.18-0.57)
0.37 (0.18-0.76)
Hypertension
0.68 (0.48-0.95)
0.89 (0.56-1.41)
Atrial fibrillation
0.66 (0.47-0.92)
1.03 (0.66-1.60)
Diabetes
0.66 (0.47-0.92)
0.75 (0.48-1.16)
Hyperlipidemia
1.07 (0.79-1.46)
1.25 (0.85-1.85)
Congestive heart failure
0.88 (0.52-1.50)
1.15 (0.61-2.16)
Previous stroke
0.76 (0.51-1.14)
0.89 (0.53-1.49)
Smoking history
Never
1 [Reference]
1 [Reference]
Former
1.13 (0.77-1.66)
1.16 (0.72-1.87)
Current
1.14 (0.76-1.72)
0.76 (0.45-1.29)
0.85 (0.54-1.33)
0.62 (0.35-1.07)
Internal carotid artery
0.94 (0.67-1.32)
0.88 (0.58-1.35)
Cervical segment
1 [Reference]
1 [Reference]
Petrous segment
1.14 (0.75-1.74)
1.03 (0.59-1.81)
Intravenous thrombolytic
Site of occlusion
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
Abbreviations: ASPECTS, Alberta Stroke Program Early
CT Score; CTP, computed tomography perfusion; DWI,
diffusion-weighted imaging; mRS, modified Rankin
scale; NCCT, noncontrast head computed tomography;
NIHSS, National Institutes of Health Stroke Scale; OR,
odds ratio.
November 11, 2022
7/11
JAMA Network Open | Neurology
Noncontrast Computed Tomography in Late-Window Thrombectomy
from CT imaging showed no difference in accuracy of CTP and NCCT ASPECTS to estimate
hyperacute stroke in MRI. Haussen et al18 studied the correlation of NCCT and CTP in a cohort of 332
showing a fair correlation between CTP ischemic core and ASPECTS (R = −0.36) and moderate
correlation between ASPECTS and final infarct volume (R = −0.42) and between CTP ischemic core
and final infarct volume (R = 0.50). This exemplifies the large variability in the CTP-derived data
among different categories of ASPECTS. Besides the lack of wide availability of perfusion imaging,
exposure to higher levels of radiation and potential delays in treatment, there are several limitations
to perfusion imaging, such as susceptibility for motion artifact, and potential errors in postprocessing
algorithms. In the MR. CLEAN trial,19 approximately 50% of patients who underwent CTP had
reported motion artifact and technical issues rendering the imaging uninterpretable.
NCCT is an essential tool to determine early ischemic changes and infarct volumes, given its
simplicity and interrater reliability. It is widely available and has potential to adequately triage
patients with emergent LVO in the late window. Computed tomography angiography and CT
perfusion continue to be the standard of care for assessing collaterals and infarct volume; however,
they can be fraught with concerns, especially due to the known risk of computed tomography
angiography underestimating collateral blood flow to penumbra and CTP’s overestimation of final
core infarct. Furthermore, Desai et al20 studied known methods to evaluate clinical severity of stroke
(NIHSS) to calculate the volume of hypoperfused tissue and during an LVO stroke and found that
NIHSS can be used as a surrogate to CTP and allow clinical stroke scale and NCCT to become primary
determinants of MT eligibility.
Strengths and Limitations
Our study’s strength is the large number of patients selected across a wide range of hospital systems
as well as the prospective nature of the database, with enrollment of consecutive patients presenting
to each of the enrolled stroke centers. Our study has limitations: internal carotid artery, middle
cerebral artery M1, middle cerebral artery M2, and ELVO only were included, and patients with mRS
0 to 2 before arrival to the hospital were selected. Imaging modality selection is dependent on
institutional practice and practitioner decision rather than standardized protocol. The DWI cohort is
small and was obtained largely from select centers. Furthermore, each individual center was
responsible for interpretation of ASPECTS and CTP and DWI studies, and this can introduce selection
bias. In the cohort with NCCT and CTP available or NCCT and DWI available, perfusion imaging was
used for clinical decision at the discretion of the neurointerventionalist.
Conclusions
In a multicenter patient cohort presenting in the late window triaged with NCCT, there was no
evidence of clinical outcome differences between NCCT and CTP or DWI triage for ELVO. For this
reason, it should be considered part of the assessment for candidacy for MT in patients with AIS
presenting beyond the 6-hour window.
ARTICLE INFORMATION
Accepted for Publication: September 26, 2022.
Published: November 11, 2022. doi:10.1001/jamanetworkopen.2022.41291
Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2022 Porto GBF
et al. JAMA Network Open.
Corresponding Author: Guilherme B. F. Porto, MD, Departments of Neurosurgery and Neuroendovascular
Surgery, Medical University of South Carolina, 96 Jonathan Lucas St, Charleston, SC 29425 (porto@musc.edu).
Author Affiliations: Department of Neurosurgery, Medical University of South Carolina, Charleston (Porto, Al
Kasab, Essibayi, Almallouhi, Hubbard, Chalhoub, Spiotta); Department of Neurosurgery, Thomas Jefferson
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
November 11, 2022
8/11
JAMA Network Open | Neurology
Noncontrast Computed Tomography in Late-Window Thrombectomy
University, Philadelphia, Pennsylvania (Chen, Jabbour); Department of Neurosurgery, Emory University, Atlanta,
Georgia (Alawieh, Grossberg); Department of Neurology, University Medical Center Göttingen, Göttingen,
Germany (Maier); Department of Radiology, University of Basel, Basel, Switzerland (Psychogios); Department of
Neurosurgery, Wake Forest University, Winston-Salem, North Carolina (Wolfe); Department of Radiology, West
Virginia University, Morgantown (Rai); Department of Neurosurgery, University of Miami Health System, Miami,
Florida (Starke); Department of Neurology, University of Iowa, Iowa City (Shaban); Department of Neurosurgery,
Semmes-Murphey Neurologic and Spine Clinic, University of Tennessee Health Science Center, Memphis (Arthur);
Department of Neurology, Chonnam National University Hospital, Gwangju, Korea (Kim); Department of
Neurosurgery, Hyogo College of Medicine, Nishinomiya, Hyogo, Japan (Yoshimura); Department of Neurosurgery,
University of Texas Medical Branch, Galveston (Kan); Neuroradiology Department, Hospital São José Centro
Hospitalar, Lisboa, Portugal (Fragata); Department of Neurosurgery, University of Florida, Gainesville (Polifka);
Department of Neurological Surgery, Washington University in St Louis, St Louis, Missouri (Osbun); Department of
Neurosurgery, University of Texas Health Science Center at San Antonio, San Antonio (Mascitelli); Department of
Neurosurgery, University of Washington, Seattle (Levitt); Department of Neurosurgery, Allegheny Health Network,
Pittsburgh, Pennsylvania (Williamson); Department of Radiology, A.O.U.S. Giovanni di Dio e Ruggi d’Aragona,
Salerno, Italy (Romano); Department of Neurosurgery, Endovascular Neurological Center, Montevideo, Uruguay
(Crosa); Department of Diagnostic and Therapeutic Neuroradiology, Centre Hospitalier Régional Universitaire de
Nancy, Nancy, France (Gory); Department of Neurosurgery, University of South Florida, Tampa (Mokin);
Department of Neurology, Indiana University, Indianapolis (Limaye); Department of Cerebrovascular and
Endovascular Neurosurgery, Hospital Juan Fernandez, Buenos Aires, Argentina (Casagrande); Department of
Interventional Neuroradiology, Washington Regional Medical Center, Fayetteville, Arkansas (Moss); Department
of Neurosurgery, University of Utah, Salt Lake City (Grandhi); Department of Neurosurgery, Texas Stroke Institute,
Plano (Yoo); Department of Neurosurgery, University of Virginia Health, Charlottesville (Park).
Author Contributions: Drs Porto and Essibayi had full access to all of the data in the study and take responsibility
for the integrity of the data and the accuracy of the data analysis.
Concept and design: Porto, Chen, Al Kasab, Almallouhi, Chalhoub, Alawieh, Psychogios, Starke, Kan, Yoo, Spiotta.
Acquisition, analysis, or interpretation of data: Porto, Chen, Amir Essibayi, Almallouhi, Hubbard, Chalhoub,
Alawieh, Maier, Wolfe, Jabbour, Rai, Starke, Shaban, Arthur, Kim, Yoshimura, Grossberg, Kan, Fragata, Polifka,
Osbun, Mascitelli, Levitt, Williamson, Romano, Crosa, Gory, Mokin, Limaye, Casagrande, Moss, Grandhi, Yoo,
Spiotta, Park.
Drafting of the manuscript: Porto, Al Kasab, Amir Essibayi, Starke, Casagrande.
Critical revision of the manuscript for important intellectual content: Porto, Chen, Al Kasab, Almallouhi, Hubbard,
Chalhoub, Alawieh, Maier, Psychogios, Wolfe, Jabbour, Rai, Starke, Shaban, Arthur, Kim, Yoshimura, Grossberg,
Kan, Fragata, Polifka, Osbun, Mascitelli, Levitt, Williamson, Romano, Crosa, Gory, Mokin, Limaye, Moss, Grandhi,
Yoo, Spiotta, Park.
Statistical analysis: Chen, Amir Essibayi, Chalhoub.
Obtained funding: Casagrande, Spiotta.
Administrative, technical, or material support: Porto, Hubbard, Alawieh, Maier, Wolfe, Starke, Grossberg, Kan,
Levitt, Williamson, Mokin, Spiotta.
Supervision: Porto, Chen, Al Kasab, Almallouhi, Psychogios, Jabbour, Starke, Shaban, Grossberg, Osbun,
Grandhi, Park.
Conflict of Interest Disclosures: Dr Chalhoub reported receiving grants from Stryker (Medical University of South
Carolina [MUSC]), Medtronic (MUSC), RAPID (MUSC), and Penumbra (MUSC) during the conduct of the study. Dr
Jabbour reported receiving consulting fees from Balt, Cerus Endovascular, MicroVention, and Medtronic outside
the submitted work. Dr Rai reported receiving personal fees from Stryker Neurovascular and Cerenovus outside
the submitted work. Dr Starke reported receiving grants from the National Institutes of Health; and consulting fees
from Medtronic, Penumbra, Cerenovus, Balt, InNeuroCo, Optimize Vascular, and Abbott outside the submitted
work. Dr Arthur reported receiving personal fees from Balt, Cerenovus, Medtronic, Microvention, Penumbra,
Perfuze, Siemens, and Stryker; consulting fees from Arsenal, Balt, Johnson & Johnson, Medtronic, Microvention,
Penumbra, Scientia, Siemens, and Stryker; and being a shareholder at Bendit, Cerebrotech, Magneto, Vastrax, and
VizAI outside the submitted work. Dr Yoshimura reported receiving personal fees from Stryker, Medtronic,
Johnson & Johnson, Kaneka Medics, Terumo, and Biomedical Solutions during the conduct of the study; personal
fees from Boehringer-Ingelheim, Daiichi Sankyo, Bayer, and Bristol-Myers Squibb outside the submitted work. Dr
Grossberg reported receiving grants from Emory Medical Care Foundation, Neurosurgery Catalyst, and Georgia
Research Alliance, and being a consultant with stock options at Cognition Medical outside the submitted work. Dr
Kan reported receiving personal fees from Stryker Neurovascular Consulting, Imperative Care Consulting,
Cerenovus Consulting, and Microvention Consulting outside the submitted work. Dr Polifka reported receiving
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
November 11, 2022
9/11
JAMA Network Open | Neurology
Noncontrast Computed Tomography in Late-Window Thrombectomy
consulting fees from Stryker and Depuy Synthes outside the submitted work. Dr Osbun reported receiving
personal fees from Medtronic, Stryker, Terumo, Microvention, Penumbra, and InNeuroCo outside the submitted
work. Dr Mascitelli reported receiving consulting fees from Stryker outside the submitted work. Dr Levitt reported
receiving grants from Medtronic and Stryker; equity interest from Proprio, Cerebrotech, Synchron, Hyperion
Surgical, and Apertur; financial interest from Fluid Biomed; consulting fees from Metis Innovative Adviser; and
support for meetings and travel from Penumbra; serving as an adviser to Aeaean; and clinical support from Stryker
Neurovascular and Medtronic outside the submitted work. Dr Romano reported receiving consulting fees from
Penumbra INC, Microvention Europe, Balt International, and Balt Italy outside the submitted work. Dr Mokin
reported being a consultant for Cerenovus, Medtronic, and Microvention and receiving stock options from Bendit
Technologies, BrainQ, Endostream, Serenity Medical, Synchros, Sim&Cure, QAS.AI, and Quantanosis.AI outside
the submitted work. Dr Grandhi reported receiving consulting fees from Medtronic Neurovascular, Cerenovus, and
Balt Neurovascular outside the submitted work. Dr Yoo reported receiving consulting fees from Cerenovus,
Penumbra, National Institutes of Health/National Institute of Neurological Disorders and Stroke, Vesalio, Zoll
Circulation; grants from Cerenovus, Penumbra, Medtronic, Stryker, Genentech; clinical support from Vesalio and
Zoll Circulation; personal fees from Cerenovus, Penumbra, Philips Neurovascular; and equity interest from Insera
Therapeutics and Nicolab outside the submitted work. Dr Spiotta reported receiving Stroke Thrombectomy and
Aneurysm Registry financial and nonfinancial support from RapidAI, Medtronic, Stryker Neurovascular, Penumbra,
and Avail; research grants from Medtronic, Stryker Neurovascular, and Penumbra; and consulting services from
Stryker Neurovascular, Penumbra, RapidAI, and Terumo outside the submitted work. No other disclosures were
reported.
Funding/Support: STAR receives financial support from RapidAI, Medtronic, Stryker Neurovascular, Penumbra,
and Avail for maintenance of research database.
Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection,
management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and
decision to submit the manuscript for publication.
Additional Contributions: The authors thank Meredith Robinson, MS, and Anna Bisig, MS (Medical University of
South Carolina), for their assistance with maintenance of registry database and data collection management.
Neither contributor was compensated beyond their normal salary for their contribution. Written permission to
include their names was obtained.
REFERENCES
1. National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. Tissue plasminogen activator
for acute ischemic stroke. N Engl J Med. 1995;333(24):1581-1587. doi:10.1056/NEJM199512143332401
2. Goyal M, Menon BK, van Zwam WH, et al; HERMES collaborators. Endovascular thrombectomy after largevessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet. 2016;387
(10029):1723-1731. doi:10.1016/S0140-6736(16)00163-X
3. Jovin TG, Chamorro A, Cobo E, et al; REVASCAT Trial Investigators. Thrombectomy within 8 hours after
symptom onset in ischemic stroke. N Engl J Med. 2015;372(24):2296-2306. doi:10.1056/NEJMoa1503780
4. Nogueira RG, Jadhav AP, Haussen DC, et al; DAWN Trial Investigators. Thrombectomy 6 to 24 hours after stroke
with a mismatch between deficit and infarct. N Engl J Med. 2018;378(1):11-21. doi:10.1056/NEJMoa1706442
5. Albers GW, Marks MP, Kemp S, et al; DEFUSE 3 Investigators. Thrombectomy for stroke at 6 to 16 hours with
selection by perfusion imaging. N Engl J Med. 2018;378(8):708-718. doi:10.1056/NEJMoa1713973
6. Albers GW, Marks MP, Lansberg MG. Thrombectomy for stroke with selection by perfusion imaging. N Engl J
Med. 2018;378(19):1849-1850. doi:10.1056/NEJMc1803856
7. Lansberg MG, Straka M, Kemp S, et al; DEFUSE 2 study investigators. MRI profile and response to endovascular
reperfusion after stroke (DEFUSE 2): a prospective cohort study. Lancet Neurol. 2012;11(10):860-867. doi:10.1016/
S1474-4422(12)70203-X
8. Albers GW, Thijs VN, Wechsler L, et al; DEFUSE Investigators. Magnetic resonance imaging profiles predict
clinical response to early reperfusion: the diffusion and perfusion imaging evaluation for understanding stroke
evolution (DEFUSE) study. Ann Neurol. 2006;60(5):508-517. doi:10.1002/ana.20976
9. Schaefer PW, Barak ER, Kamalian S, et al. Quantitative assessment of core/penumbra mismatch in acute stroke:
CT and MR perfusion imaging are strongly correlated when sufficient brain volume is imaged. Stroke. 2008;39
(11):2986-2992. doi:10.1161/STROKEAHA.107.513358
10. Powers WJ, Rabinstein AA, Ackerson T, et al. Guidelines for the early management of patients with acute
ischemic stroke: 2019 update to the 2018 guidelines for the early management of acute ischemic stroke:
a guideline for healthcare professionals from the American Heart Association/American Stroke Association.
Stroke. 2019;50(12):e344-e418. doi:10.1161/STR.0000000000000211
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
November 11, 2022
10/11
JAMA Network Open | Neurology
Noncontrast Computed Tomography in Late-Window Thrombectomy
11. Boned S, Padroni M, Rubiera M, et al. Admission CT perfusion may overestimate initial infarct core: the ghost
infarct core concept. J Neurointerv Surg. 2017;9(1):66-69. doi:10.1136/neurintsurg-2016-012494
12. Naylor J, Churilov L, Chen Z, Koome M, Rane N, Campbell BCV. Reliability, reproducibility and prognostic
accuracy of the alberta stroke program early CT score on CT perfusion and non-contrast CT in hyperacute stroke.
Cerebrovasc Dis. 2017;44(3-4):195-202. doi:10.1159/000479707
13. Nguyen TN, Abdalkader M, Nagel S, et al. Noncontrast computed tomography vs computed tomography
perfusion or magnetic resonance imaging selection in late presentation of stroke with large-vessel occlusion. JAMA
Neurol. 2022;79(1):22-31. doi:10.1001/jamaneurol.2021.4082
14. Yoshimura S, Sakai N, Yamagami H, et al. Endovascular therapy for acute stroke with a large ischemic region.
N Engl J Med. 2022;386(14):1303-1313. doi:10.1056/NEJMoa2118191
15. Campbell BC, Mitchell PJ, Kleinig TJ, et al; EXTEND-IA Investigators. Endovascular therapy for ischemic stroke
with perfusion-imaging selection. N Engl J Med. 2015;372(11):1009-1018. doi:10.1056/NEJMoa1414792
16. Hacke W, Kaste M, Bluhmki E, et al; ECASS Investigators. Thrombolysis with alteplase 3 to 4.5 hours after acute
ischemic stroke. N Engl J Med. 2008;359(13):1317-1329. doi:10.1056/NEJMoa0804656
17. Demeestere J, Garcia-Esperon C, Garcia-Bermejo P, et al. Evaluation of hyperacute infarct volume using
ASPECTS and brain CT perfusion core volume. Neurology. 2017;88(24):2248-2253. doi:10.1212/WNL.
0000000000004028
18. Haussen DC, Dehkharghani S, Rangaraju S, et al. Automated CT perfusion ischemic core volume and
noncontrast CT ASPECTS (Alberta Stroke Program Early CT Score): correlation and clinical outcome prediction in
large vessel stroke. Stroke. 2016;47(9):2318-2322. doi:10.1161/STROKEAHA.116.014117
19. Campbell BCV, Majoie CBLM, Albers GW, et al; HERMES collaborators. Penumbral imaging and functional
outcome in patients with anterior circulation ischaemic stroke treated with endovascular thrombectomy versus
medical therapy: a meta-analysis of individual patient-level data. Lancet Neurol. 2019;18(1):46-55. doi:10.1016/
S1474-4422(18)30314-4
20. Desai SM, Ortega-Gutierrez S, Sheth SA, et al. Clinically approximated hypoperfused tissue in large vessel
occlusion stroke. Stroke. 2021;52(6):2109-2114. doi:10.1161/STROKEAHA.120.033294
SUPPLEMENT.
eTable. Missing Data for Each Respective Variable at the Time of Data Analysis
JAMA Network Open. 2022;5(11):e2241291. doi:10.1001/jamanetworkopen.2022.41291 (Reprinted)
Downloaded From: https://jamanetwork.com/ on 11/13/2022
November 11, 2022
11/11