Drones
Drones
Drones
Patrick B. Johnston
RAND Corporation
Anoop K. Sarbahi
Stanford University
February 11, 2014
Abstract
This study analyzes the eects of US drone strikes on terrorism in Pakistan
and Afghanistan. Some theories suggest that drone strikes anger Muslim
populations, and that consequent blowback facilitates recruitment and incites
Islamist terrorism. Others argue that drone strikes disrupt and degrade terrorist
organizations, reducing their ability to conduct attacks. We use detailed data
on U.S. drone strikes and terrorism in Pakistan and Afghanistan from 2004-2011
to test each theorys implications. The available data does not enable us to test
whether drone strikes have resulted in increased recruitment, but it does allow
us to examine whether these strikes have resulted in changes in their activities.
We nd that drone strikes are associated with decreases in the incidence and
lethality of terrorist attacks, as well as decreases in particularly intimidating
and deadly terrorist tactics, including suicide and improvised explosive devices
(IED) attacks. While our ndings do not suggest that these eects are long-term,
the results do lend some credence to the argument that drone strikes, while
unpopular, have bolstered U.S. counterterrorism eorts in Pakistan.
Earlier versions of this article were presented at the 2011 Annual Meetings of the American
Political Science Association, the Belfer Center for Science and International Aairs at Harvard
Universitys Kennedy School of Government, and the New America Foundation. For helpful feedback
on earlier versions, we thank Peter Bergen, James Dobbins, Daniel Egel, C. Christine Fair, Brian
Fishman, Melissa Willard-Foster, Joshua Foust, Seth G. Jones, Jennifer Keister, Akbar Khan, Peter
Krause, Sean Lynn-Jones, Steven E. Miller, Jacob N. Shapiro, Arthur Stein, Katherine Tiedemann and
Jeremy Weinstein. Johnston acknowledges nancial support from AFOSR Award #FA9550-09-1-0314.
1 Introduction
Do drone strikes against terrorists reduce the threat posed by terrorist organizations,
or do they unintentionally increase support for anti-U.S. militants and thus fuel
terrorism?
1
Empirical studies of targeted killings and civilian casualties in counterin-
surgency and counterterrorism show that both outcomes are possible (Valentino et
al., 2004; Downes, 2007; Stanton, 2009; Jordan, 2009) Strikes conducted by remotely
piloted aircraft may undermine counterterrorism eorts or enhance them depending
on the nature of the violence, the intentionality attributed to it, or the precision
with which it is applied.(Kalyvas, 2006; Downes, 2007; Kocher et al., 2011). Existing
research has studied the eects of coercive airpower,(Pape, 1996; Horowitz and Reiter,
2001), targeted killings (Jaeger, 2009; Jordan, 2009; Johnston, 2012; Price, 2012) and
civilian victimization (Kalyvas, 2006; Lyall, 2009; Condra and Shapiro, 2012), but
social scientists have conducted little empirical analysis of the eects of drone strikes.
2
While the debate over the use of drones for counterterrorism eorts has intensied,
the arguments, both for and against their usage, although informed by plausible
logics, are supported primarily by anecdotal evidence and not by systematic empirical
investigation. This lack of attention is unfortunate: unmanned aerial vehicles, and
their lethal targeting capabilities, are likely to represent a critical aspect of current
and future counterterrorism eorts.
The consequences of drone strikes are a critical policy concern. The United States
has frequently been called upon to cease drone strikes in Pakistan in order to protect
noncombatants, but instead it has expanded its use of drones to other countries
in which al Qaida-aliated militants are believed to operate, such as Somalia and
Yemen.
3
The laws governing international armed conict codify and strengthen
1
Examples of arguments that drone strikes are ineective or counterproductive include
NYU/Stanford (2012); Cronin (2009). Examples of arguments that drone strikes are eective
include Fair (2010, 2012) and Byman (2013).
2
Exceptions include Jaeger and Siddique (2011); Smith and Walsh (2013).
3
For excellent descriptions of the drone wars expansion, see Mazzetti (2013) and Scahill (2013).
1
norms against targeted killings, yet other interpretations of the laws of war leave
civilian ocials and military commanders with substantial latitude to target enemy
combatants believed to be aliated with terrorist organizations against which the U.S.
has declared war (Gray, 2000). Liberal democratic states face substantial pressures to
protect civilians in war, but at the same time are often confronted with substantial
uncertainty as to what abiding by legal principles such as discrimination the
obligation of military forces to select means of attack that minimize the prospect of
civilian casualties actually entails (Crawford, 2003; Walzer, 2006).
Arguably, drone strikes are not the only instrument the U.S. can use to ght
al Qaida terrorists; states have used other methods to ght terrorism for centuries.
The eectiveness of drone strikes at countering terrorism lies at the core of U.S.
policymakers arguments for their continued use. Yet because of the drone programs
secretive nature and wide disagreement about the eects of drone strikes on terrorist
organizations and civilian populations, U.S. government ocials and human rights
advocates have both failed to present compelling, systematic evidence in support of
their positions. What is needed is a rigorous, evidence-based assessment of drone
strikes impact on terrorist activities. Such an assessment should sharpen the debate
on drone strikes and help counterterrorism ocials and critics alike to evaluate the
tradeos associated with drone warfare.
The present study is a step in that direction and uses a data-driven approach to
analyze the consequences of drone strikes. Based on the available detailed data on
both drone strikes and terrorism in Pakistan, the study examines how drone strikes,
triggering changes in the behavior of terrorists, have aected terrorist violence in
northwest Pakistan and bordering areas of Afghanistan. In order to provide the most
comprehensive analysis possible, this study investigates the relationship between drone
strikes and a wide range of militant activities and tactics, including terrorist attack
patterns, terrorist attack lethality, and especially deadly and intimidating tactics such
2
as suicide and improvised explosive device (IED) attacks. The available data do not
allow us to examine whether drone strikes have resulted in increased recruitment
in terrorist organization a key argument advanced by the opponents of the drone
program. However, the data do allows us to investigate the impact of drone strikes on
terrorism measured in terms of the terrorist activities mentioned here, which, unlike
recruitment, are more widely recorded and reported.
A systematic analysis of the data reveals that drone strikes have succeeded in
curbing deadly terrorist attacks within the targeted territory in Pakistan. Specically,
the key ndings of our study show that drone strikes are associated with substantial
reductions in terrorist violence along four key dimensions. First, drone strikes are
generally associated with a reduction in the rate of terrorist attacks. Second, drone
strikes are also associated with a reduction in the number of people killed as a result
of terrorist attacks, i.e., the lethality of attacks. Third, drone strikes tend to be linked
to decreases in the use of particularly lethal and intimidating tactics, including suicide
and IED attacks. Fourth, the study nds that this reduction in terrorism is not the
result of militants leaving unsafe areas and conducting attacks elsewhere in the region;
on the contrary, there is some evidence to suggest that drone strikes have a small
violence-reducing eect in areas near those struck by drones. However, this work only
studies short-term changes, extending over a few weeks, in terrorist violence and our
ndings do not provide a basis to conclude that the eects of drone strikes on these
measure of terrorist violence extends beyond the week during which they take place.
Taken together, these ndings suggest that despite their unpopularity, drone strikes
do aect terrorist activities and claims that drones have aided U.S. counterterrorism
eorts in Pakistan should not be dismissed out of hand.
The remainder of the article proceeds as follows. In Section 2, we outline the
range of relevant hypotheses on the eects of drone strikes, and briey discuss the
theoretical logics that undergird them. In Section 3, we describe our dataset and the
3
methodology used to assess the eects of drone strikes on terrorism. In Section 4, we
discuss the results of our empirical analysis and our interpretation of key ndings.
Finally, Section 5 concludes with a discussion of our ndings implications for policy
and the future of counterterrorism.
2 Hypotheses on Drone Strikes and Terrorism
Two contradictory arguments characterize the debate concerning the eectiveness of
drone strikes. The rst focuses on how drone strikes aect the attitudes of the civilian
population, while the second focuses on the impact of drone strikes on insurgent and
terrorist organizations.
2.1 Drone Strikes, the Civilian Population, and Militant Mo-
bilization
The rst argument is that drone strikes do little to curb terrorism and might increase
it. Critics have suggested, for example, that drone attacks are ineective or counter-
productive to the U.S. strategy of disrupting and dismantling al Qaida and other
terrorist networks because they are unpopular among the Pakistani population, largely
because they occasionally inict civilian casualties.
Consistent with this argument, Smith and Walsh nd no evidence that drone strikes
degrade al Qaida propaganda eorts (Smith and Walsh, 2013). Taking this argument
a step further, others argue drone strikes are the wrong tool to curb militancy in
fact, they may worsen it because the tactic itself breeds a counterproductive desire
for revenge among Pakistanis who might otherwise harbor no hostilities toward the
United States. In the words of Kilcullen and Exum (2009), Every one of these dead
noncombatants represents an alienated family, a new desire for revenge, and more
recruits for a militant movement that has grown exponentially even as drone strikes
4
have increased. Given the expected anticipated anti-U.S. mobilization and desire
for revenge among the civilian population suggested by this logic, we elaborate the
following hypothesis:
H1: All else equal, drone strikes increase terrorist violence.
2.2 Disruption, Degradation, and Militant Capabilities
The second argument, which is common among U.S. counterterrorism ocials but
rarely buttressed with empirical evidence due to secrecy surrounding drone programs,
contends that drone strikes are eective at reducing the terrorist threat posed by
targeted groups. Two mechanisms are frequently cited: disruption and degradation.
2.2.1 Disruption
The rst mechanism counterterrorism ocials cite involves disruption of militant
operations. The disruption mechanism suggests drone strikes reduce militants ability
to operate in a cohesive, eective manner and erode their ability to exercise sovereign
control over local areas. Even if an insurgent or terrorist organization is the only armed
actor on the ground, as they often are in FATA, where state authority is extremely
weak, the greater the threat from above, the more costly it is for the militants to
exercise de facto control in that area.
The standard logic of violence would predict that this innovation should lead us to
anticipate an increase in terrorist violence as a result of their eorts to deter defection
(Kalyvas, 2006) In contrast, our argument predicts that, in this scenario, militant
violence should decrease, both in terms of its frequency and its lethality. The reason is
that drone strikes in an area represent a meaningful indication of an increased security
risk to militants operating in that area. The increased risk associated with continuing
to operate in the targeted areas should apply to any type of militant activity that
is vulnerable to drone capabilities, including conducting terror attacks, regardless of
5
whether militants would otherwise conduct operations at their average rate and level
of lethality (i.e., the null hypothesis), or if they would otherwise escalate the frequency
and lethality of their operations to deter potential defectors (i.e., the alternative logic
of violence hypothesis). We thus advance the following hypothesis:
H2: All else equal, drone strikes decrease terrorist violence.
2.2.2 Degradation
The second mechanism by which drones can reduce terrorism is through a degradation
eect. According to this argument, drone strikes reduce terrorism by taking terrorist
group leaders and other high-value individuals (HVIs) o the battleeld, consequently
hindering the terrorists ability to produce violence at a sustained rate. Killing
operational leaders of al Qaida and its aliated movements is the primary objective
of drone strikes.
4
Indeed, drone strikes have resulted in the deaths of many top terrorists. According
to an Obama administration ocial, the U.S. eliminated at least 20 of al Qaidas 30 top
leaders from 2009 to 2012 in Pakistan and Afghanistan.
5
In Pakistan alone, according
to the New America Foundation, drone strikes killed 51 militant leaders, including
28 senior al Qaida operatives, between 2004 and early 2013.
6
They have also killed
several high-level Pakistani and Afghan Taliban and al Qaida-aliated leaders.
7
An emerging political science literature investigates the eects of leadership
decapitation the killing or capture of militant leaders or other HVIswith a focus
on evaluating the group-level eects of killing or capturing top insurgent or terrorist
4
Remarks of President Barack Obama, speech delivered at National Defense University,
May 23, 2013. Accessed online at http://www.whitehouse.gov/the-press-office/2013/05/23/
remarks-president-barack-obama. Last accessed on July 5, 2013.
5
Two-Thirds of Top Qaeda Leaders Removed Since 2009: Obama Aide, Reuters, December 18,
2012. Quoted in International Crisis Group, Drones: Myths and Reality in Pakistan, Crisis Group
Asia Report N
j=i
w
ij
y
jt
+ x
it
+ h
t
+
it
. (2)
where is the spatial autoregressive coecient, which measures the general strength
of spatial dependence, w
ij
is an element of the spatial weight matrix reecting the
degree of connection between two units i and j, y
jt
is the measure of militant violence
for unit j during time period t, x
it
is the number of drone strikes in unit i at time t,
i
are unobserved agency-specic eects, and h
t
are quarterly time eects.
3.3 Data and Variables
To examine the eect of drone strikes, we combined detailed data on US drone strikes
in FATA originally collected by researchers at the New America Foundation (NAF)
(Bergen and Tiedemann, 2011) with incident-level data on terrorist activities in FATA
during the same time period compiled in the National Counterterrorism Centers
(NCTC) Worldwide Incidents Tracking System (WITS) National Counterterrorism
Center (2012) and incidents of militant violence against tribal elders compiled by
the South Asia Terrorism Portal (SATP).
24
Incidents from each data source were
georeferenced according to the reported locations of the incidents in the media accounts
used to track and cross-reference each drone strike and militant attack.
The NAF data on drone strikes include information on the incidence, date, and
location of each strike, the high and low estimates of fatalities that have occurred in
23
See, for instance,Franzese Jr and Hays (2007). We also performed the Pesaran cross-sectional
dependence (CD) test on the residuals of the estimated models. See Pesaran (2007). The results of
the CD test are available upon request.
24
The SATP data were accessed online at http://www.satp.org/satporgtp/countries/
pakistan/database/Tribalelders.htm. Last accessed June 15, 2013.
15
each strike, deaths of militant leaders in drone strikes, and the sources of information
that were used to compile each summary. The data were compiled from reports in
reputed international and Pakistani news media sources.
The WITS database uses fairly standard criteria in coding incidents as terror-
ist attacks. To be included as a terrorist attack in the WITS database, activities
were required to be incidents in which sub-national or clandestine groups or in-
dividuals deliberately or recklessly attacked civilians or non-combatants, including
military personnel and assets outside war zones (National Counterterrorism Center,
2012). Moreover, attacks have to be initiated and executed by non-state militants.
Spontaneous violence, hate crimes and genocides are excluded from the database.
Using data that focuses on terrorist incidentsviolence against civilian rather than
military targetsis justiable for both theoretical and empirical reasons. Theoretically,
Kalyvas (2006) argues that the combatants are likely to target civilians selectively in
their zones of control as a result of real or perceived spying by civilians. A similar
narrative is often used to describe militant responses to drone strikes in FATA: militants
believe drone strikes are the result of informant betrayal, and thus target suspected
informants (Bennett, 2011).
Along these lines, tribal elders typically associated with a local incumbency
have been cited as particularly common targets (Fishman, 2010). We use data on
militant attacks on tribal elders in Pakistan from 2005 through 2011 compiled by
SATP.
25
The inclusion of this variable is warranted by the suggestion that drone
strikes increase attacks on tribal elders whom militants suspect of collaborating with
U.S. or Pakistani military or intelligence services.
Table 1 summarizes the variables and data sources used in our analysis. We focus
on drone strikes and four key measures of terrorist activity. Our data set contains
information on the following variables at the agency-week level:
25
The SATP data were compiled from open-source media reports, primarily from south Asian
sources, by the Institute of Conict Management, New Delhi.
16
UAV: The number of drone strikes in a given agency and week.
HVT: The number of senior leaders killed by drone strikes in a given agency
and week. (Source: New America Foundation)
Incidents: The number of militant incidents or attacks in a given agency and
week.
Lethality: The number of dead and wounded in terrorist incidents or attacks
in a given agency and week.
IED Attacks: The number of IED attacks conducted in a given agency and
week.
Suicide Attacks: The number of suicide attacks conducted in a agency and
week.
Attack on Tribal Elder(s): The number of militant attacks against tribal
elders in a given agency and week.
3.4 Descriptive Statistics
For this study, we constructed an agency-week dataset. The time-series spans from
January 1, 2007 through September 30, 2011. Descriptive statistics of key variables
over this time period are shown in Table 1.
Figures 13 illustrate the variation in terrorist attacks and drone strikes over space
(Figure 1) and time for all of FATA (Figure 2) and for its constituent agencies (Figure
3). Figure 2 shows the monthly time trend of drone strikes and terrorist attacks for all
of FATA from 2007 through September 2011. Militant attacks began trending upward
in mid-2007, peaking in early 2009 before declining back to roughly mid-2007 levels by
Fall 2011. Drone strikes (left axis) were relatively rare until Fall 2008 before August
2008, when four strikes were conducted, there had never been more than one strike in
17
a month. At the agency level, Figure 3 shows that North Waziristan closely mirrors
the macro trend, with trends uctuating more in South Waziristan and Khyber while
being relatively rare elsewhere in FATA.
In the statistical analysis presented in the next section, all measures of terrorist
violence have been normalized using agency and district population to create a series
representing the number of violent incidents per 1000 residents. Our rationale for
normalizing the data by population is that the cross-agency population variance likely
inuences levels of terrorist activity for reasons unrelated to drone strikes. Eliminating
this variance should thus enhance our ability to draw inferences from our statistical
results. The population gures for Pakistan are from the 1998 census and the gures
for Afghanistan are from the estimates for 2006 published by the Central Statistics
Oce.
4 Empirical Results
A cursory look might suggest the former: as Figure 2 shows, violence rose from 2007
until 2009 and was as high in September 2011, when our time-series ends, as in any
year since 2007. Yet Figure 2 also shows that the rise of drone strikes appears to
have been a response to a deteriorating environment in which terrorist violence was
increasing dramatically. It is thus plausible that the drone wars escalation occurred
as a result of real and anticipated increases in terrorist violence. Given the upward
trend in terrorist violence prior to the escalation of the drone campaign, and the
observed variation in terrorist attacks across agencies, the use both week- and agency-
xed eects helps mitigate confounding impacts of secular time trends in terrorist
violence and of agency-specic dierences, using these within regressions to estimate
the average eect of drone strikes within agencies over time.
26
26
As a robustness test, we also ran regressions using a series of model specications including
ordinary least square (OLS) and involving temporal lags, spatial lags, and rst-dierences, both with
18
4.1 Disruption
Table 2 presents the 2FESL estimates of drone strikes on four measures of militant
violence. The spatial lag included in the 2FESL models measures the value of our
dependent variables in the districts falling within 75 km of the centroid of the agency
in which strikes occurred.
To test Hypotheses 1 and 2, we examine ve dierent measures of militant violence:
the frequency of attacks, the lethality of attacks, the number of IED attacks, the
number of suicide attacks, and the number of attacks on tribal elders. The results,
which are presented in Table 2, do not support Hypothesis 1that drone strikes
are associated with increased terrorism. On the contrary, they support our thesis,
Hypothesis 2: Drone strikes are associated with a decrease in militant violence. We
nd no evidence in support of the competing hypothesis (Hypothesis 1)that drone
strikes increase violence. These substantive eects of drone strikes on these measure
of militant violence are presented in Figure 4. We discuss these results in more detail
below.
The 2FESL estimate in column 1 of Table 2 show that drone strikes are associated
with an average decrease in militant attacks of almost 5 percentage points. This
result is statistically signicant at the one percent level. From 2007 through 2011,
the average agency suered roughly 0.88 militant attacks per week. During weeks in
which a drone strike occurred, agencies suered an average of about 0.68 attacks.
Given that drone strikes are associated with reductions in militant attacks in the
areas where they occur, we also expect drone strikes to be negatively associated with
the lethality, or quality, of militant attacks in these same areas. This is indeed the
case. Further consistent with Hypothesis 2, the estimate presented in column 2 of
Table 2 suggests that the lethality of militant attacks declined by an average of nearly
and without xed eects. We also conducted two panel unit-root tests, the Breitung and Pesaran
tests, which both allow for cross-sectional dependence (Breitung and Pesaran, 2008; Pesaran, 2007).
Results of these tests are available on request.
19
25 percentage points in a given week in which a drone strike occurred. On average,
2.77 people were killed or injured in militant attacks in FATA between 2007 and the
end of the third quarter of 2011. This gure would decline substantially to 1.73 per
week as a result of a single drone strike if the number of drone strikes would increase
by one per agency-week.
27
The disruption mechanism described above implies that drone strikes should reduce
militants ability to conduct complex and coordinated attacks, such as IED attacks
and suicide attacks. Our results provide support for these propositions. As the point
estimates in columns 3 and 4 of Table 2 show, drone strikes were negatively associated
with both IED and suicide attacks conducted in FATA agencies during the period
studied. Both estimates are statistically signicant at the one-percent level.
28
Drone
strikes were also associated with a decline in militant attacks on tribal elders.
On balance, the results shown in Table 2 provide strong support for Hypothesis 2:
Drone strikes were associated with a decline in local militant violence in FATA from
20072011. The evidence is consistent with observable implications of a disruption
mechanism, suggesting that the threat to militants posed by drone strikes inhibit
insurgent and terrorist groups from conducting operational activities at the same rate
at which they are able to perpetrate such activities in the absence of drone strikes.
27
It is important to note that the estimate of decline in lethality of militant attacks is based on an
assumption of a constant linear relationshipan assumption that may or may not be correct. The
predicted decline is probably an overstatement of the impact drones could realistically have, simply
because even at the peak of the drone campaign in 2010, when the number of drone strikes was two
and a half times larger than the previous year (119 in 2010, versus 53 in 2009), the number of drones
per campaign-week in 2010 was 0.33, while it was 0.14 in 2009.
28
Suicide attacks are relatively rare but extremely high-prole events: the mean number of suicide
attacks per agency per week is 0.02, or about one per agency every year. The point estimate appears
small, but the marginal eect translates into an almost 69 percent decline in the number of suicide
attacks in a week with one drone strike. Thus, the average number of weekly suicide attacks in FATA,
which is 0.14 per week during the period under consideration, would decline to 0.04 per week as a
result of one drone strike per agency-week.
20
4.2 Degradation
Given that killing terrorist leaders or HVIs in terrorist organizations is the purpose
of drone strikes, we evaluate whether patterns of militant attacks dier following
strikes in which a militant leader was killed. Table 3 displays the results of tests of
Hypotheses 3 and 4, based on four of the outcomes assessed in Table 2. The results
shown in Table 3 are based on the same 2FESL estimation technique used in Table 2.
The results are largely consistent with Hypothesis 3 that drone strikes that result in
the death of a militant leader is associated with decreased militant violence.
There is little support for Hypothesis 4, which suggested that killing militant
leaders has a counterproductive, violence-increasing, eect. Controlling for the number
of drone strikes per agency-week, the point estimate displayed in column 1 of Table 3
indicates that the death of a senior militant leader in a drone strike was associated
with a reduction in the number of militant incidents that occur. This result is
statistically signicant at the one-percent level. The negative coecients of the HVI
variable in columns 24 of Table 3 suggest the possibility that removing senior militant
leaders was also associated a decline in militant lethality, IED attacks, and suicide
attacks. However, the results shown in columns 24 are not statistically signicant at
conventional levels.
29
Overall, there is some evidence that key militant leaders matter for a terrorist
organizations ability to conduct operational activitiesnamely, to conduct terrorist
attacks. However, there is only inconclusive evidence that removing key leaders through
drone strikes reduced the lethality of the attacks that militants managed to conduct or
reduced militant organizations ability to conduct sophisticated attacks. Nonetheless,
29
These estimates may be more imprecise than the statistical results suggest, as a result of
heterogeneity in the measurement of the HVI variable. Although U.S. government ocials consider
terrorists targeted by drone strikes target as senior leaders or high-value individuals (HVI), the
U.S. government has not publicly stated the criteria it uses to identify individual terrorists as senior
leaders or HVIs. Available information on individuals identied as leaders killed in drone attacks
suggests a degree of heterogeneity
21
along with other evidence from macro-level studies of leadership decapitation, the
present results suggest that critics who argue against the ecacy of removing key
gures may be overemphasizing the extent to which key individuals can be easily
replaced without compromising operational eciency (Johnston, 2012; Price, 2012).
4.3 Diversion
A potential concern with the previous ndings is that it is possible that drone strikes
do not actually reduce terrorist violence, but instead displace it. While drone strikes
might cause militant activities to decline in the targeted agencies, they may cause an
escalation in militant violence in proximate areas that are not subject to drone strikes
if militants move their operations in response to UAV targeting in FATA. The concern
with spillover eects is not just academic; media reporting points to it as a possible
policy concern (Rodriguez, 2010).
To assess these claims, we extend the above analysis by estimating the eect of
drone strikes beyond the seven FATA agencies in neighboring areas within various
distances of agencies where strikes have occurred. To do this, we vary the radius of
struck agencys neighborhood, from 25 kilometers to 150 kilometers, by increments of
25 kilometers. By testing the eect of drone strikes on militant violence in geographic
units that expand outward to varying distances, we assess how drone strikes aect
militancy beyond specic FATA agencies.
Table 4 presents the results of a test of the spillover hypothesis. Each column in
these tables presents estimates of the eect of drone strikes on militant violence in
a neighborhood of a particular radius, beginning with a radius of 25 kilometers in
column 1 and ending with a radius of 150 kilometers in column 6. In the rst two
rows of Table 4, we present estimates of the eect of drone strikes on the number
of militant attacks in the proximate neighborhood of the agency in which drone
strikes occurred. The sign of the drone strike estimate is negative up to 125 km and is
22
statistically signicant at 25 kilometers and 100 kilometers at the ve-percent and
ten-percent levels, respectively. The coecient becomes positive at a radius of 150
km, but the positive coecients are small and are not statistically signicant. The
estimates of the eect of drone strikes on militant lethality and on IED attacks in
similarly-dened neighborhoods display a pattern similar to the militant attack
estimates, suggesting that militant lethality decreased within a 50-kilometer radius
from struck agencies and IED attacks decreased within a 25-kilometer radius of struck
agencies. The results deviate slightly for suicide attacks from the other observed
trends. Unlike the other dependent variables, the coecient associated with suicide
attacks does not change signs from negative to positivethe results remain negative
for each of the radii tested, and are statistically signicant at the one-percent level
within a 25-kilometer radius of struck agencies.
Overall, the evidence suggests that drone strikes not only reduce militant violence
in the local agencies in which they are conducted, but also in proximate areas, to
varying degrees depending on the outcome of interest. There is no conclusive evidence
that drone strikes cause violence to spill over into neighboring areas. As such, there is
no evidence that drone strikes have a whack-a-mole eect in which militant violence
is pushed to other areaspossibly because militants fear that the unblinking eye of
unmanned drones are surveilling their activites in these areas as well.
5 Duration
If the evidence indicates that drone strikes help disrupt and degrade terrorist group
operations in Pakistan, a nal question is how long drone strikes violence-reducing
eects last. Table 5 displays results of a variety of tests of this question. Using a
model that included ve one-week lags of drone strikes, the results in columns 2
and 4 of Table 5 show a statistically signicant and negative relationship between
23
drone strikes that occurred ve weeks prior (t-5) and attack lethality (column 2)
and suicide attacks (column 4). Moreover, the sign of the coecients of the drone
strikes variable at t-5 are negative for both number of incidents and IED attacks, but
are not statistically signicant at conventional levels. However, both the sign and
signicance of the coecient estimates for each of the dependent variables shown in
Table 5 are inconsistent, suggesting that the violence-reducing eects of drone strikes
on certain types of militant activities might last as long as ve weeks, but that noise
and additional unobservable variation associated with the lagged variables makes it
dicult to make denitive claims about the duration of drones violence-reducing
eects.
These inconsistencies are also observed when the tests are extended to areas neigh-
boring targeted agencies. This is not surprising, given the additional unobservables
introduced by attempting to evaluate drone strikes more indirect eects spatially.
However, there is some evidence to suggest that the lethality of militant attacks in
agencies contiguous to those that were struck declined following a drone strike, and
that the eect might have lasted as long as ve weeks (column 2). Still, it remains
unclear why a statistically signicant, negative, eect should obtain in some weeks
but not others, particularly for longer lags, such as ve weeks. As opposed to the
results presented in Table 2, which were both more conclusive and also consistent
with theoretical predictions, the possibility that the statistically signicant, negative
relationships observed in Table 5 are the result of chance.
As a result, the results shown in Table 5 provide only limited support for Hypothesis
6. Additional study of the duration of drone strike eects on militant behavior is
needed for a clearer understanding of these dynamics.
24
6 Conclusion
This paper oers a systematic analysis of the relationship between U.S. drone strikes
and militant violence in northwestern Pakistan and eastern Afghanistan. Our analysis
suggests that drone strikes are negatively associated with various measures of militant
violence, both within individual FATA agencies and their immediate neighborhoods.
As should be expected, our ndings show that the results presented in this study
of the eects of drone strikes on militant behavior, albeit strong, are primarily
contemporaneous, and there is only limited evidence of their persistence over longer
periods of time. Such a temporal dynamic may explain the relative persistent use of
drone strikes in militant strongholds in the Tribal Areas of northwestern Pakistan and
southern Yemen, suggesting the possibility that persistent counterterrorism pressure
might need to be applied to militant organizations in order to curb their cycles of
violence.
Nonetheless, the plausible exogeniety of the week-to-week timing and location
of drone strikes, as discussed earlier, gives us condence that these ndings can be
interpreted as causal. Still, despite the econometric techniques used to mitigate
selection bias in our analysis, caution in inferring causality is necessary due to the
possibility of selection bias, which is inherent in any observational study.
These same challenges make it dicult to come to any denitive conclusions
concerning possible spillover eects of drone strikes. While we nd a statistically
signicant decline in militant violence in the immediate vicinity of drone strikes, and
the coecient remains negative up to a distance of 125 kilometers, only some of these
ndings are statistically signicant and do not adhere to a clear set of theoretical
predictions. These outstanding questions require further data collection and empirical
inquiry.
30
30
Arguably, circular and distance-based neighborhoods may not adequately reect the dynamics
of militant violence, which is more likely to be driven by the spatial distribution of the network of
militant groups. Geographical proximity may constitute an important factor, but may not be the
25
Still, our ndings provide key support for the hypothesis that new technologies
specically, remote means of surveillance, reconnaissance and targetingare able, at
least in certain key areas of northwest Pakistan, to disrupt and degrade militants
in ways that compensate for an incumbent governments lack of physical presence
in and control over these areas, and can consequently limit both the frequency and
the lethality of militant attacks, as well as relatively sophisticated and psycholgically
damaging forms of violence that are preferred tactics of modern terrorist groups,
such as IED and suicide attacks. This suggests that new technologies that provide
information previously available only to actors with a strong physical presence in a
geographic area might be altering conventionally accepted logics of violence in civil
war (Kalyvas, 2006).
The implication of these ndings, of course, is that as technology continues to
become increasingly sophisticated, warfare is likely to become increasingly virtual,
if not bloodless. Adversariesnot only governments, but also non-state actors such
as insurgents, terrorists, and criminal organizationswill adapt their organizational
strategies and behavior in an attempt to reduce their vulnerability to state counter-
measures, and some are likely to try to leverage new technologiespossibly including
drones, whether armed or unarmedfor their own use. In the near term, however, the
technological advantages powerful states such as the U.S. hold might cause insurgents
to increasingly abandon rural areas, such as FATA, in favor of urban areas of the sort
that insurgents have traditionally eschewed, in search of the protection that urban
areas can oer (Jenkins, 1971; Fair, 2005; Staniland, 2010; Kilcullen, 2013).
only or even the dominant determinant. Moreover, if militant activities are indeed getting displaced
as a result of a drone strike, the spread is more likely to follow the spatial mapping of the network of
militant groups in the region and may not be uniform in all directions as we move away from an
agency. This we hope to explore in future.
26
References
Angrist, Joshua D. and Jorn-Steen Pischke, Mostly Harmless Econometrics:
An Empiricists Companion, Princeton, NJ: Princeton University Press, 2009.
Bennett, Dashiell, Pakistani Death Squads Target Informants Who Help Drone
Attacks, The Atlantic Wires, December 29 2011.
Bergen, Peter and Katherine Tiedemann, New America Foundation Drones
Database, 2011.
Berman, Eli, Jacob N Shapiro, and Joseph Felter, J. Felter (2008):Can
hearts and minds be bought? The economics of counterinsurgency in Iraq, NBER
Working Paper, 2008, (14606).
Berrebi, Claude and Esteban F. Klor, Are Voters Sensitive to Terrorism? Direct
Evidence from the Israeli Electorate, American Political Science Review, September
2008, 102 (03), 279301.
Breitung, J. and M. H. Pesaran, Unit roots and cointegration in panels, The
Econometrics of Panel Data, 2008, pp. 279322.
Byman, Daniel, Why Drones Work: The Case for Washingtons Weapon of Choice,
Foreign Aairs, July/August 2013, 92.
Condra, Luke and Jacob N. Shapiro, Who Takes the Blame? The Strategic
Eects of Collateral Damage, American Journal of Political Science, January 2012,
56 (1), 167187.
Crawford, Neta C., Just War Theory and the U.S. Counterterror War, Perspec-
tives on Politics, March 2003, 1 (1), 525.
Cronin, Audrey Kurth, How terrorism ends: Understanding the decline and demise
of terrorist campaigns, Princeton University Press, 2009.
27
de Mesquita, Ethan Bueno, The Quality of Terror, American Journal of Political
Science, July 2005, 49 (3), 515530.
Downes, Alexander B., Draining the Sea by Filling the Graves: Investigating the
Eectiveness of Indiscriminate Violence as a Counterinsurgency Strategy, Civil
Wars, December 2007, 9 (4), 420444.
Fair, C Christine, Urban battle elds of South Asia: lessons learned from Sri Lanka,
India, and Pakistan, Santa Monica, CA: Rand Corporation, 2005.
Fair, C. Christine, Clear, Hold, Build, Transfer: Can Obamas Afghan Strategy
Work?, September 2010.
, For Now, Drones Are the Best Option, September 26, 2012.
Fishman, Brian, The Battle for Pakistan: Militancy and Conict across the FATA
and NWFP, Counterterrorism Strategy Initiative Policy Paper. The New America
Foundation. April.(Accessed:), April 2010.
Flynn, Michael T., Rich Juergens, and Thomas L. Cantrell, Employing ISR
SOF Best Practices, Joint Force Quarterly, 2008, 50 (3rd Quarter).
Gray, Christine D., International Law and the Use of Force, New York: Oxford
University Press, 2000.
Gul, Imtiaz, The most dangerous place : Pakistans lawless frontier /, 1st american
ed. ed., New York, NY, Viking,, 2010.
Horowitz, Michael and Dan Reiter, When does aerial bombing work? Quanti-
tative empirical tests, 1917-1999, Journal of Conict Resolution, April 2001, 45
(2), 147173.
28
Jaeger, David A., The Shape of Things to Come? On the Dynamics of Suicide
Attacks and Targeted Killings, Quarterly Journal of Political Science, December
2009, 4 (4), 315342.
and Zahra Siddique, Are Drone Strikes Eective in Afghanistan and Pakistan?
On the Dynamics of Violence between the United States and the Taliban, IZA
Discussion Paper No. 6262, November 2011.
Jenkins, Brian Michael, The ve stages of urban guerrilla warfare: challenge of
the 1970s, Rand Corp, 1971.
Johnston, Patrick B., Does Decapitation Work? Assessing the eectiveness of
Leadership Targeting in Counterinsurgency Campaigns, International Security,
Spring 2012, 36 (4), 4779.
Jordan, Jenna, When Heads Roll: Assessing the Eectiveness of Leadership De-
capitation, Security Studies, 2009, 18 (4), 719755.
Jr, R. J. Franzese and J. C. Hays, Spatial econometric models of cross-sectional
interdependence in political science panel and time-series-cross-section data, Polit-
ical Analysis, 2007, 15 (2), 140164.
Kalyvas, Stathis N., The Logic of Violence in Civil War, New York: Cambridge
University Press, 2006.
Kilcullen, David, Out of the Mountains: the coming age of the urban guerrilla, New
York: Oxford University Press, 2013.
and Andrew Exum, Death from Above, Outrage Down Below, New York
Times, May 17 2009, p. WK13.
29
Kocher, Matthew A., Thomas B. Pepinsky, and Stathis N. Kalyvas, Aerial
Bombing and Counterinsurgency in the Vietnam War, American Journal of Political
Science, April 2011, 55 (2), 201218.
Krueger, Alan B., What Makes a Terrorist: Economics and the Roots of Terrorism,
Princeton, NJ: Princeton University Press, August 2007.
Lyall, Jason, Does Indiscriminate Violence Incite Insurgent Attacks?: Evidence
from Chechnya, Journal of Conict Resolution, February 2009, 53 (3), 331362.
Mazzetti, Mark, The Way of the Knife: The CIA, a Secret Army, and a War at
the Ends of the Earth, New York: Penguin, 2013.
National Counterterrorism Center, Worldwide Incidents Tracking System,
2012.
Nawaz, Shuja., FATAa Most Dangerous Place: Meeting the Challenge of Militancy
and Terror in the Federally Administered Tribal Areas of Pakistan, Center for
Strategic & Intl studies, 2009.
NYU/Stanford, Living Under Drones: Death, Injury, and Trauma to Civilians
From US Drone Practices in Pakistan, Technical Report, International Human
Rights and Conict Resolution Clinic, Stanford Law School and Global Justice
Clinic, NYU School of Law September 2012.
Pape, Robert A., Bombing to Win: Air Power and Coercion in War, Ithaca, NY:
Cornell University Press, 1996.
Pesaran, M. Hashem, A simple panel unit root test in the presence of cross-section
dependence, Journal of Applied Econometrics, 2007, 22 (2), 265312.
Phillips, P. C. B. and D. Sul, Dynamic panel estimation and homogeneity testing
under cross section dependence*, The Econometrics Journal, 2003, 6 (1), 217259.
30
and , Bias in dynamic panel estimation with xed eects, incidental trends
and cross section dependence, Journal of Econometrics, 2007, 137 (1), 162188.
Price, Bryan, Targeting Top Terrorists: How Leadership Decapitation Contributes
to Counterterrorism, International Security, Spring 2012, 36 (4), 946.
Radsan, Afsheen and Richard Murphy, Due Process and Targeted Killing of
Terrorists, Cardozo Law Review, May 2009, 31 (2), 405450.
Rodriguez, Alex, U.S. concerns grow as militants move bases along Pakistan
border, 2010.
Scahill, Jeremy, Dirty Wars: The World is a Battleeld, New York: Nation Books,
2013.
Smith, Megan and James Igoe Walsh, Do Drone Strikes Degrade al Qaeda?
Evidence from Propaganda Output., Terrorism and Political Violence, 2013, 25
(2), 311327.
Staniland, Paul, Cities on Fire: Social Mobilization, State Policy, and Urban
Insurgency, Comparative Political Studies, December 2010, 43 (12), 16231649.
Stanton, Jessica, Strategies of Violence and Restraint in Civil War. Ph.d. disser-
tation, Columbia University, New York 2009.
Valentino, Benjamin, Paul Huth, and Dylan Balch-Lindsay, Draining the
Sea: Mass Killing and Guerrilla Warfare, International Organization, 2004, 58
(2), 375407.
Walzer, Michael, Just and unjust wars: A moral argument with historical illustra-
tions, New York: Basic Books, 2006.
Wooldridge, Jerey M, Econometric analysis of cross section and panel data,
Cambridge, Mass.: MIT Press, 2002.
31
F
i
g
u
r
e
1
:
D
r
o
n
e
S
t
r
i
k
e
s
a
n
d
M
i
l
i
t
a
n
t
A
t
t
a
c
k
s
i
n
F
A
T
A
&
i
t
s
N
e
i
g
h
b
o
r
h
o
o
d
32
Figure 2: Time Trends in Drone Strikes and Terrorist Attacks
33
F
i
g
u
r
e
3
:
T
i
m
e
T
r
e
n
d
s
i
n
D
r
o
n
e
S
t
r
i
k
e
s
a
n
d
M
i
l
i
t
a
n
t
A
t
t
a
c
k
s
b
y
A
g
e
n
c
y
34
T
a
b
l
e
1
:
S
u
m
m
a
r
y
S
t
a
t
i
s
t
i
c
s
:
F
A
T
A
&
N
e
i
g
h
b
o
r
h
o
o
d
F
A
T
A
N
e
i
g
h
b
o
r
h
o
o
d
A
f
g
h
a
n
i
s
t
a
n
P
a
k
i
s
t
a
n
V
a
r
i
a
b
l
e
M
e
a
n
S
.
D
.
*
M
i
n
.
M
a
x
.
M
e
a
n
S
.
D
.
*
M
i
n
.
M
a
x
.
M
e
a
n
S
.
D
.
*
M
i
n
.
M
a
x
.
M
e
a
n
S
.
D
.
*
M
i
n
.
M
a
x
.
U
A
V
0
.
1
5
3
0
.
6
0
5
0
8
H
V
I
.
0
2
3
1
0
.
1
8
1
0
3
I
n
c
i
d
e
n
t
s
0
.
8
8
0
1
.
3
3
3
0
1
3
0
.
1
8
3
0
.
7
3
2
0
1
7
0
.
6
8
1
3
.
0
4
4
0
7
7
1
.
8
2
4
5
.
5
0
0
0
9
1
L
e
t
h
a
l
i
t
y
2
.
7
7
7
1
4
.
0
1
9
0
2
8
5
0
.
6
8
9
6
.
7
5
9
0
3
6
1
2
.
1
4
8
2
1
.
9
8
2
0
1
3
0
5
7
.
6
9
6
6
1
.
1
3
5
0
2
2
1
9
I
E
D
A
t
t
a
c
k
s
0
.
3
1
6
0
.
7
3
4
0
7
0
.
0
6
3
0
.
3
6
0
0
1
1
0
.
2
2
9
1
.
5
9
2
0
7
0
0
.
6
5
8
2
.
6
7
4
0
4
9
S
u
i
c
i
d
e
A
t
t
a
c
k
s
0
.
0
2
0
0
.
1
4
9
0
2
0
.
0
0
9
0
.
1
0
2
0
4
0
.
0
3
8
0
.
5
5
9
0
2
8
0
.
0
8
5
0
.
7
4
4
0
2
1
A
t
t
a
c
k
s
o
n
T
r
i
b
a
l
E
l
d
e
r
s
0
.
0
1
3
0
.
1
1
2
0
1
N
u
m
b
e
r
o
f
O
b
s
e
r
v
a
t
i
o
n
s
1
7
2
9
5
0
8
2
2
3
7
7
9
1
1
3
0
9
1
*
S
t
a
n
d
a
r
d
D
e
v
i
a
t
i
o
n
35
Table 2: Drone Strikes and Terrorist Violence: 2FESL Estimates
Incidents Lethality IED Suicide Attacks on Elders
UAV -0.048*** -0.247*** -0.016*** -0.003*** -0.001**
(0.010) (0.090) (0.005) (0.001) (0.001)
Constant 0.023 0.136 0.004 0.000 0.005**
(0.020) (0.200) (0.010) (0.002) (0.002)
Observations 1729 1729 1729 1729 1729
AIC 473.224 8998.330 -1448.116 -6737.893 -7594.435
BIC 620.517 9145.623 -1300.823 -6590.600 -7447.142
Standard errors in parentheses
* p<0.10, ** p<0.05, *** p<0.01
Table 3: Leaders Killed and Militant Violence: 2FESL Estimates
Incidents Lethality IED Suicide
UAV -0.012 -0.136 -0.022*** -0.001
(0.010) (0.100) (0.007) (0.001)
HVI -0.092*** -0.057 -0.002 -0.001
(0.040) (0.200) (0.01) (0.002)
Constant 0.205*** 0.649*** 0.075*** 0.005***
(0.008) (0.08) (0.004) (0.001)
Observations 1729 1729 1729 1729
AIC 417.207 8751.883 -1606.601 -6977.664
BIC 433.572 8768.249 -1590.235 -6961.298
Standard errors in parentheses
* p<0.10, ** p<0.05, *** p<0.01
36
Figure 4: Substantive Eect of Drone Strikes
(a) Militant Attacks (b) Lethality
(c) IED Attacks (d) Suicide Attacks
(e) Attacks on Tribal Elders
Note: All plots with 95 percent condence interval.
37
Table 4: Drone Strikes and Neighborhood Militant Violence
Neighborhood Radius
Dependent Variable 25 km 50 km 75 km 100 km 125 km 150 km
Incidents -0.042*** -0.022 -0.009 -0.007* -0.004 0.002
(0.010) (0.010) (0.006) (0.004) (0.004) (0.003)
Lethality -0.252*** -0.152* -0.037 0.081 0.055 0.038
(0.090) (0.080) (0.040) (0.050) (0.040) (0.030)
IED Attacks -0.014*** -0.002 -0.002 -0.001 -0.001 0.002
(0.005) (0.009) (0.003) (0.002) (0.002) (0.002)
Suicide Attacks -0.003*** -0.003 -0.001 -0.000 -0.000 -0.000
(0.001) (0.003) (0.001) (0.0008) (0.0006) (0.0004)
Observations 1722
Standard errors in parentheses. Coecient estimates for drone strike (UAV) variable. Intercept estimates not presented.
* p<0.10, ** p<0.05, *** p<0.01
38
Table 5: The Duration of the Eect of Drone Strikes
(1) (2) (3) (4)
VARIABLES Incidents Lethality IED Suicide
UAV -0.030*** -0.11*** -0.011** -0.0023***
(0.0049) (0.0086) (0.0038) (0.000076)
UAV
t-1
0.0056 -0.033 0.0054 -0.0010**
(0.010) (0.044) (0.0053) (0.00040)
UAV
t-2
-0.0011 -0.045 0.0080 0.00047
(0.0088) (0.032) (0.0066) (0.0010)
UAV
t-3
0.017* -0.061 0.016** -0.0014***
(0.0084) (0.035) (0.0064) (0.00019)
UAV
t-4
-0.0034 0.088 -0.0090** 0.0019
(0.012) (0.14) (0.0029) (0.0015)
UAV
t-5
-0.0087 -0.16*** -0.0013 -0.0033***
(0.0098) (0.027) (0.0096) (0.00028)
Neigborhood UAV
t-1
-0.0045 0.46 0.0047 -0.00019
(0.028) (0.56) (0.013) (0.0043)
Neigborhood UAV
t-1
-0.0047 -0.34*** 0.011 0.012*
(0.019) (0.061) (0.017) (0.0050)
Neigborhood UAV
t-2
0.0043 -0.20 -0.016 -0.0058
(0.059) (0.32) (0.016) (0.0040)
Neigborhood UAV
t-3
-0.015 -0.24 -0.0062 -0.0011
(0.059) (0.34) (0.025) (0.0038)
Neigborhood UAV
t-4
-0.0047 -0.20** -0.000024 0.0077
(0.044) (0.061) (0.025) (0.0059)
Neigborhood UAV
t-5
0.077
(0.041)
Incident
t-1
0.16***
(0.034)
Incident
t-2
0.13***
(0.034)
Neighbohood Incident
t-1
0.077
(0.041)
Lethality
t-1
0.0053
(0.024)
Lethality
t-2
0.00087
(0.0098)
Neighbohood Lethality
t-1
-0.043
(0.079)
IED
t-1
0.23***
(0.043)
IED
t-2
0.049***
(0.013)
Neighborhood IED
t-1
0.038
(0.039)
Suicide
t-1
0.050
(0.055)
Suicide
t-2
-0.017
(0.020)
Neighborhood Suicide
t-1
0.014
(0.044)
Constant 0.14*** 0.72*** 0.049*** 0.0050***
(0.010) (0.057) (0.0057) (0.00053)
Observations 1,694 1,694 1,694 1,694
39
Appendix A: Robustness Tests
Here we evaluate whether the results are sensitive to certain time periods. The drone
war escalated signicantly in 2008 relative to previous years; drone strikes increased
again in both 2009 and 2010, and remained higher in 2011 than in 2008. Given
that we cannot rule out that unobserved changes in FATA, starting approximately
in 2008, drive this change, we restrict the sample to 2008 and later to test whether
the patterns that we observed in the previously discussed results hold during this
later period. Table A-1 shows that the main ndings do hold when we estimate the
2FESL specication for each of the measures of violence with the sample restricted to
observations after 2007. In Table A-2, we extend our analysis to an additional three
years by starting from the beginning of 2004, the year of the rst-known drone strike
in FATA. The results are remarkably similar to the main ndings.
Table A-1: Drone Strikes and Terrorist Militant Violence: 2008-2011
Incidents Lethality IED Attacks Suicide Attacks Attacks on Elders
UAV -0.034*** -0.194*** -0.012** -0.001*** -0.001*
(0.142) (0.089) (0.005) (0.001) (0.001)
Constant 0.079*** 1.137*** 0.040** 0.004*** 0.005***
(0.025) (0.534) (0.015) (0.001) (0.002)
Observations 1456 1456 1456 1456 1456
AIC 480.277 7792.078 -1051.775 -5902.082 -6176.432
BIC 607.080 7918.881 -924.9727 -5891.515 -6049.629
Standard errors in parentheses
* p<0.10, ** p<0.05, *** p<0.01
Table A-2: Drone Strikes and Militant Violence: 2004-2011
Incidents Lethality IED Attacks Suicide Attacks Attacks on Elders
UAV -0.051*** -0.227*** -0.021*** -0.003*** -0.002***
(0.010) (0.076) (0.005) (0.001) (0.001)
Constant 0.120 0.035 0.005 0.0003 0.002**
(0.012) (0.086) (0.006) (0.001) (0.001)
Observations 2912 2912 2912 2912 2912
AIC -273.484 13654.120 -3737.697 -12867.330 -13228.340
BIC -34.42016 13893.180 -3498.633 -12628.270 -12989.270
Standard errors in parentheses
* p<0.10, ** p<0.05, *** p<0.01
40