Personality and Individual Differences 42 (2007) 987–998
www.elsevier.com/locate/paid
Psychometric properties of the French versions of the
BIS/BAS scales and the SPSRQ
Hervé Caci
a
a,*
, Olivier Deschaux b, Franck J. Baylé
c
Centre Hospitalier Universitaire de Nice, Hôpital Archet 2, Service de Pédiatrie, 06202 Nice Cedex 3, France
b
Laboratoire de Neurobiologie and Psychopathologie, Parc Valrose, Faculté des Sciences,
Université de Nice Sophia-Antipolis, 06108 Nice Cedex 2, France
c
Service Hospitalo-Universitaire, Centre Hospitalier Sainte-Anne 7, rue Cabanis 75014 Paris, France
Received 25 January 2006; received in revised form 21 July 2006; accepted 1 September 2006
Available online 24 October 2006
Abstract
One of the most recurrent criticisms formulated against Gray’s Reinforcement Sensitivity Theory is the
lack of a sound structural model of the postulated dimensions, i.e. ‘Anxiety’ and ‘Impulsivity’ reflecting the
behavioural inhibition and approach systems, respectively. Although valuable efforts have been made and
several instruments been published in the past fifteen years, most of the publications conclude that refinements are needed. This is the first paper that presents the psychometric properties of the French version of
Carver and White’s BIS/BAS scales and Torrubia et al.’s SPSRQ in a sample of students. The reliabilities
and the pattern of scores intercorrelations are in line with the literature. For both instruments, exploratory
factor analyses reveal a two-order structure with higher-order factors representing BIS-SP and BAS-SR.
The structure of the primary factors is discussed with regards to studies in non-French speaking samples.
These findings add to the cross-cultural data for the BIS/BAS scales and the SPSRQ, which is an underestimated aspect of scales’ development.
Ó 2006 Elsevier Ltd. All rights reserved.
Keywords: Reward sensitivity theory; BIS; BAS; Sensivitity to punishment; Sensitivity to reward; Psychometric
properties; Factor analysis; Cross-cultural
*
Corresponding author. Tel.: +33 0 492039291; fax: +33 0 492036567.
E-mail address: caci.h@chu-nice.fr (H. Caci).
0191-8869/$ - see front matter Ó 2006 Elsevier Ltd. All rights reserved.
doi:10.1016/j.paid.2006.09.008
988
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
1. Introduction
For the past forty years, Jeffrey Gray and colleagues developed the most influential motivationbased theory of personality traits: the Reinforcement Sensitivity Theory (RST) (Gray &
McNaughton, 2003). It postulates the existence of two major and orthogonal dimensions of personality, namely Anxiety and Impulsivity, regulated by the Behavioural Inhibition System (BIS)
and the Behavioural Approach System (BAS), respectively. In the latest version of the RST, BAS
is responsive to all positively valenced stimuli (presentation of reward or termination/omission of
punishment) and BIS is responsive to conflicting goals (e.g. approaching an appetivite stimulus in
the presence of a punishment cue). Recently, a Joint Subsystem Hypothesis has been proposed in
which the BIS and BAS are no longer independent (Corr, 2001, 2002).
One of the main problems with Gray’s theory is that sound psychometric measures have not yet
been developed in spite of valuable efforts (Caseras, Avila, & Torrubia, 2003; Corr, 2001). Furthermore, cross-cultural properties have not been extensively studied (Leone, Perugini, Bagozzi,
Pierro, & Mannetti, 2001; Müller & Wytykowska, 2005). Indeed, Gray’s development is more
comprehensive for BIS than for BAS. Since Gray’s theory initially appeared as a modification
of Eysenck’s, some authors have been inclined to use Extraversion and Neuroticism measures
as proxy for Impulsivity and Anxiety, respectively (Caseras et al., 2003). Others have created
instruments among which Carver and White’s BIS/BAS scales are the most widely used (Carver
& White, 1994), but interest is deserved as well for the Sensitivity to Punishment and Sensitivity to
Reward Questionnaire (SPSRQ) (Torrubia, Avila, Molto, & Caseras, 2001), the Appetitive Motivation Scale (Jackson & Smillie, 2004), the General Reward And Punishment Expectancies
(GRAPES) (Ball & Zuckerman, 1990), and the Gray-Wilson Personality Questionnaire (GWPQ)
(Wilson, Gray, & Barrett, 1990). Most if not all available instruments were developed before 2000,
that is on the basis of an earlier version of the RST. This point is more relevant for studies aimed
at testing the validity of the theory, than for those regarding the psychometric properties of a given instrument. Only the GWPQ takes into consideration the third system postulated in the latest
revision of the model: the Fight-Flight System (FFS). Each brain/behavioural system is divided in
two subfactors, Activation is measured by Approach and Active Avoidance, Inhibition by Passive
Avoidance and Extinction, and Fight/Flight by Defensive Aggression and Flight. Factor analysis
provided only limited support to this two-order structure.
1.1. BIS/BAS scales
Many authors consider that Carver and White published one of the best attempts to measure
Gray’s dimensions. Regardless of language and scale’s length, the reliabilities range between 0.58
for RR (Müller & Wytykowska, 2005) and 0.83 for DRIVE (Heubeck, Wilkinson, & Cologon,
1998). Regardless of language and sample sizes, the mean scale intercorrelations are about
+0.35 except for unsignificant values between BIS and DRIVE, and BIS and FUN. With regard
to the Kaiser criterion, Carver and White (1994) extracted four factors though a 5-factor structure
might have been viable (Heubeck et al., 1998; Müller & Wytykowska, 2005). Unfortunately the
test authors did not report all the values of the rotated pattern matrix, preventing any comparison
with other published material. They found that all BAS-related scale scores define a second-order
factor. The correlation between BIS and RR unweighted scores has been consistently replicated
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
989
(Heubeck et al., 1998; Müller & Wytykowska, 2005; O’Connor, Colder, & Hawr, 2004). In all
these exploratory studies, item cross-loadings made the structure not simple, and Confirmatory
Factor Analyses (CFA) showed that a simple 4-factor structure did not fit the data in terms of
significant v2 (Cogswell, Alloy, van Dulmen, & Fresco, 2006; Heubeck et al., 1998; Müller &
Wytykowska, 2005; Ross, Millis, Bonebright, & Bailley, 2002) unless item parcelling was used
(Leone et al., 2001). Interestingly, the factorial and measurement invariances were established
in the latter study across English- and Italian-speaking samples. That is, the same latents are measured in the same way in both samples. Unfortunately the authors did not mention what items
they summed in each parcel nor did they give the covariance matrices for reproduction purposes.
In this partial disaggregation model however, the BIS and RR latent variables correlated in all
three samples, and with DRIVE in the Italian sample only ( 0.33). Besides this clever attempt,
the cross-cultural validity of the BIS/BAS scales remains unclear.
1.2. The SPSR questionnaire
Quite recently, Spanish authors proposed a questionnaire to measure Sensitivity to Punishment
(SP) and Sensitivity to Reward (SR) which are related to BIS and BAS, respectively (Torrubia
et al., 2001). A scree test after Principal Component Analysis (PCA) on a large sample
(N = 1563) suggested to extract two components in both genders. Several items loaded poorly
but were kept for future investigation. The reliability is slightly lower for SR (a = 0.75) than
SP (a = 0.82) in both genders, a result replicated later (Caseras et al., 2003; O’Connor et al.,
2004). An Exploratory Factor Analysis (EFA) with the English version found many items with
small loadings and a small but significant correlation between the factors but not between unweighted scores (+0.18 and 0.01, respectively, N = 603) (O’Connor et al., 2004). This study
found no support for the two-factor structure using CFA in three independent samples even after
removing 13 of the 48 items. A similar conclusion was drawn in another CFA study on two independent samples (Cogswell et al., 2006). These findings suggest that the SPSRQ should undergo
psychometric refinement: ‘‘bad’’ items, additional factors, high-order structure, cross-cultural
validity and/or translation accuracy between Catalan and English are cited as possible issues.
This is the first paper to present the reliability, factor structure and validity of the French version of the BIS/BAS scales and the SPSRQ. Since these instruments are grounded in a strong theoretical biological basis, a fair replication of published works is expected. Furthermore, we
postulate a second-order structure for both instruments, and a simple high-order structure with
the BIS and SP scales loading on the same factor, and the BAS and SR scales loading on an almost orthogonal factor. This could initiate a sound refinement of both instruments in future
studies.
2. Methods
2.1. Participants
Before leaving the classroom at the end of a course, students at the University of Nice Sophia
Antipolis were asked to fill out a booklet. They participated anonymously and were volunteers.
990
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
One hundred and forty seven questionnaires were collected but one subject did not give his date of
birth. Three subjects did not answer all the valid items of the BIS/BAS (n = 144, 109 females) and
eleven subjects did not answer all the SPSRQ items (n = 136, 100 females).
2.2. Measures
The SPSRQ and the BIS/BAS scales were translated into French by the first author and then
back-translated into English by a bilingual University collaborator naive to psychology concepts.
The 24 BIS/BAS items are scored on a 4-point Likert-type scale (from 1 = Strongly agree to
4 = Strongly disagree) arranged in four scales: BIS (7 items), BAS-Reward Responsiveness (5
items), BAS-Drive (4 items) and BAS-Fun Seeking (4 items). There are four filler items and
two BIS items are reversed. The SP and SR are two 24-item scales with dichotomously scored
items. None is reversed, even items form the SR scale and odd items the SP scale. In this study,
the items were slightly reworded to allow their scoring on a 4-point Likert-type (from 1 = Totaly
true to 4 = Totaly wrong) to reduce the bias of correlation coefficients (Bollen & Barb, 1981), and
because a joint factor analysis is planned in our future studies. The original scoring keys were
used.
2.3. Data analysis
Only complete questionnaires were analysed with STATA 9.2. The polychoric inter-item correlation matrix was computed for each instrument separately. To determine the number of factors
to be extracted, a scree test and a parallel analysis were conducted after a PCA. Parallel analysis
consists in comparing the eigenvalues obtained in the sample to those one would expect to obtain
from random data (1000 random correlation matrices in this study). This method is now recommended as the best method to assess the true number of factors (Lance, Butts, & Michels, 2006).
From published work, four factors were expected for the BIS/BAS scales (BIS, FUN, RR,
DRIVE) and two for the SPSRQ. Since the FUN, RR and DRIVE scales are supposed to measure a single BAS construct, we hypothesised that the structure of the SPSRQ might be more complex than just two orthogonal factors. Hence restricted EFAs were performed, resulting factors
were obliquely rotated with the PROMAX criterion (with d = 4), and second-order EFAs were
performed. Any orthogonal rotation would have prohibited a second-order EFA.
3. Results
Descriptive statistics and score correlations are presented (Tables 1 and 2, respectively). Most
scores are normally distributed. The median for age is 21.11 years (135 participants were under 30
years old), and females are older than males (Mann–Whitney test: z = 2.707, p < 0.007). The effect
of sex is significant on BIS only: t(142) = 3.826 (p = 0.0002). Age does not correlate with any
score, BIS correlates with SP and SR in females, but with SP only in males (Table 2). The
BAS scales correlate more with SR than SP in both genders with the exception of FUN in females.
To gain in comparability with English versions that found SP and SR to be orthogonal and did
not consider genders separately (O’Connor et al., 2004), we partialled out the +0.288 rank-order
991
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
Table 1
Descriptive statistics for the original scores : mean ± SD, range, Shapiro–Wilk test of normality (W), Cronbach’s a
Entire sample
Males
Females
Age
(N = 146; 111 females)
23.00 ± 6.33
[16.08; 52.38]
W = 0.567***
24.95 ± 8.04
[16.08; 51.78]
W = 0.707***
22.36 ± 5.59
[18.17; 52.38]
W = 0.507***
BIS
(N = 144; 109 females)
21.35 ± 3.69
[9; 30]
W = 0.986
a = 0.744
19.37 ± 3.33
[12; 26]
W = 0.982
a = 0.608
21.99 ± 3.58
[9; 30]
W = 0.974*
a = 0.749
Fun seeking
11.41 ± 2.36
[5; 20]
W = 0.992
a = 0.720
11.17 ± 2.67
[5; 16]
W = 0.970
a = 0.834
11.49 ± 2.26
[5; 20]
W = 0.989
a = 0.675
DRIVE
9.74 ± 2.24
[5; 17]
W = 0.989
a = 0.581
9.69 ± 2.18
[6; 14]
W = 0.982
a = 0.461
9.75 ± 2.27
[5; 17]
W = 0.986
a = 0.626
Reward responsiveness
16.27 ± 2.36
[8; 20]
W = 0.976*
a = 0.673
15.54 ± 2.54
[8; 20]
W = 0.965
a = 0.702
16.51 ± 2.26
[12; 20]
W = 0.991
a = 0.652
Sensitivity to punishment
(N = 136; 100 females)
58.47 ± 11.10
[33; 104]
W = 0.977*
a = 0.870
56.44 ± 9.41
[41; 78]
W = 0.972
a = 0.852
59.20 ± 11.61
[33; 104]
W = 0.974*
a = 0.880
Sensitivity to reward
55.19 ± 10.01
[34; 108]
W = 0.945***
a = 0.847
55.78 ± 7.75
[34; 71]
W = 0.973
a = 0.731
54.98 ± 10.73
[35; 108]
W = 0.933***
a = 0.870
*
***
p < 0.05.
p < 0.001.
correlation found in our sample (N = 136) from each of the eight correlations between BIS/BAS
scales, SP and SR. Thus BIS correlates .514 with SP (versus .53), RR correlates .543 with SR (versus .24), DRIVE correlates .467 with SR (versus .20), and FUN correlates .386 with SR (versus
.34). Hence, in both languages, BIS and SP are fair indicators of the same construct, while the
three BAS subscales and SR are fair indicators of another construct.
3.1. The BIS/BAS scales
Feldt statistics (not shown) indicate that the reliabilities of the BIS/BAS scales are similar to
those reported by the test authors except for DRIVE that, in turn, has a value as small as that
reported by the Catalan authors (Caseras et al., 2003). After Fisher transformation, we find
992
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
Table 2
Pairwise Spearman rank-order correlations
Age
Age
BIS
FUN
DRIVE
RR
SP
SR
1
0.162
0.134
0.062
0.084
0.028
0.085
BIS
FUN
0.107
1
0.035
0.119
0.448***
0.508***
0.409***
DRIVE
0.075
0.253
1
0.353***
0.361***
0.222*
0.277**
RR
0.167
0.113
0.083
1
0.277**
0.117
0.465***
SP
0.137
0.110
0.286
0.304
1
0.212*
0.525***
0.198
0.630***
0.198
0.220
0.089
1
0.300**
SR
0.305
0.051
0.410*
0.620***
0.457**
0.305
1
Females are in the lower triangle (N = 100 except for BIS/BAS scores where N = 109), Males are in the upper triangle
(N = 36 except with age or BIS/BAS scores where N = 35).
*
p < 0.05.
**
p < 0.01.
***
p < 0.001.
BIS and each BAS scales correlating with a similar magnitude as those reported in the literature
except that the correlations are higher in the Polish sample (Müller & Wytykowska, 2005). The
correlation between BAS scales are in line with the literature.
We examined the fit of the original model using CFA and three different estimators: Maximum
Likelihood without (ML) and with Satorra–Bentler scaling (MLM), and Muthen’s Weight Least
Squares with Mean and Variance correction (WLSMV). The fit was poor with all three conditions: v2(164) = 278.043 (CFI = 0.818, RMSEA = 0.070), v2(164) = 247.710 (CFI = 0.845,
RMSEA = 0.060), and v2(47) = 125.434 (CFI = 0.841, RMSEA = 0.109), respectively. Hence,
an exploratory approach is recommended in our sample.
The graph of the eigenvalues of the polychoric correlation matrix is straightforwardly interpreted (Fig. 1). The first six eigenvalues are greater than 1.000 (5.051, 3.311, 1.724, 1.536,
1.168, 1.038) but, according to the original structure, the parallel analysis and the scree test only
the first four are extracted and rotated. The pattern matrix, uniqueness vector and factor intercor-
6
5
4
3
2
1
0
1
2
3
4
5
6
7
8
9
10
Fig. 1. Graph of eigenvalues after Principal Component Analysis of the polychoric matrix (diamonds) and after
parallel analysis (squares).
993
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
relation matrix are presented (Table 3). Fifteen items (75%) load on their expected factor only.
Items 7 (RR), 9 (DRIVE) and 18 (RR) do not load on any four factors. Item 14 (RR) cross-loads
on BIS and FUN. Item 19 (BIS) cross-loads on BIS and RR. Overall, the postulated structure is
mostly recovered across language and RR items are problematic. The EFA on the interfactor correlation matrix returned a simple structure with FUN and DRIVE loading on the first second-order factor, and BIS and RR loading on the other one. These higher-order factors correlated at
+0.523 (p < 0.0001).
3.2. The SPSR questionnaire
The reliabilities of SP and SR are similar to those found in the literature (Table 1). Scores correlate at +0.30 in both genders (Table 2) whereas near zero values have been reported in Catalan
(Caseras et al., 2003; Torrubia et al., 2001) and English samples (O’Connor et al., 2004).
We examined the fit of the original two-factor model and the shortened model proposed by
O’Connor et al. (2004) using CFA with the ML, MLM and WLSMV estimators. The shortened
Table 3
Exploratory factor analysis restricted to four factors (n = 144)
Variable
bisbas2
bisbas3
bisbas4
bisbas5
bisbas7
bisbas8
bisbas9
bisbas10
bisbas12
bisbas13
bisbas14
bisbas15
bisbas16
bisbas18
bisbas19
bisbas20
bisbas21
bisbas22
bisbas23
bisbas24
Expected factor
Factor 1
Factor 2
Factor 3
Factor 4
BIS
FUN
RR
DRIVE
BIS
DRIVE
RR
FUN
RR
BIS
DRIVE
FUN
DRIVE
BIS
RR
FUN
BIS
RR
BIS
FUN
DRIVE
BIS
RR
BIS
0.689
0.057
0.007
0.124
0.355
0.591
0.033
0.131
0.127
0.728
0.417
0.150
0.778
0.382
0.416
0.133
0.014
0.474
0.091
0.565
0.034
0.043
0.149
0.856
0.372
0.039
0.091
0.810
0.107
0.136
0.513
0.538
0.220
0.201
0.235
0.561
0.204
0.133
0.031
0.240
0.160
0.136
0.690
0.154
0.334
0.150
0.242
0.113
0.285
0.159
0.215
0.349
0.040
0.160
0.508
0.171
0.098
0.262
0.669
0.160
0.170
0.726
0.110
0.147
0.061
0.002
0.124
0.009
0.515
0.080
0.258
0.258
0.077
0.081
0.031
0.176
0.797
0.065
0.195
0.025
Factor 2
Factor 3
Factor 4
0.181*
0.402**
0.068
1
0.298**
0.394**
1
0.149
1
Loadings greater than 0.400 are in bold.
*
p < 0.05.
**
p < 0.001.
Uniqueness
0.433
0.388
0.345
0.165
0.249
0.432
0.736
0.311
0.385
0.283
0.208
0.488
0.320
0.616
0.316
0.387
0.363
0.499
0.386
0.438
994
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
model did not fit the data by far: v2(494) = 1004.340 (CFI = 0.621, RMSEA = 0.087),
v2(494) = 942.959 (CFI = 0.636, RMSEA = 0.082), and v2(62) = 245.684 (CFI = 0.684,
RMSEA = 0.148), respectively. The MLM and the WLSMV estimator both failed to converge
when using the 48 original indicators, and the ML estimator showed an unacceptable fit:
v2(1079) = 1974.113 (CFI = 0.555, RMSEA = 0.078). Hence, an exploratory approach is recommended in our sample.
Since the polychoric correlation matrix was singular, we analyzed a product–moment correlation matrix. Fig. 2 shows that many eigenvalues are greater than 1.000 (the first ten eigenvalues
are: 8.847, 4.275, 2.068, 1.794, 1.688, 1.640, 1.440, 1.387, 1.293). We decided to extract and rotate
both a two-factor solution to keep in line with the a priori structure and a four-factor solution
suggested by both the scree test and the parallel analysis. The pattern matrix, uniqueness vector
and factor intercorrelation matrix are presented (Table 4). The two-factor solution resembles the
original structure, most items loading on their expected factor. Some load poorly on their expected factor (i.e. below the arbitrary threshold of 0.400) but their secondary loading falls in
the hyperplane. The four-factor solution deserves attention since factors can be named relatively
easily: Fear of being rejected, Fear of the unknown, Competition and Arousal. Factor 2 is independent of both Factors 3 and 4, but other factor intercorrelations are significant. Two secondorder factors could be extracted from the first-order factor correlation matrix that correlate
+0.256 (p < 0.01). The first one encompasses the factors ‘‘Fear of being rejected’’ and ‘‘Fear of
the unknown’’ while the second encompasses the factors ‘‘Competition’’ and ‘‘Arousal’’. As a
means for identifying them, we computed the correlation between the factor scores and the original unweighted scale scores. The first second-order factor correlates +0.970 with SR (+0.417 with
SP) while the second correlated +0.945 with SP (+0.539 with SR).
A last unshown EFA with the eight factorial scores reveals a BAS factor that encompasses
FUN, DRIVE and the two SR first-order factors, and a BIS factor that encompasses BIS and
10
9
8
7
6
5
4
3
2
1
0
1
2
3
4
5
6
7
8
9
10
Fig. 2. Graph of eigenvalues after Principal Component Analysis of the product-moment matrix (diamonds) and after
parallel analysis (squares).
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
995
Table 4
Exploratory factor analyses restricted to two and four factors (n = 136)
Variable
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
Item
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
Scale
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
SP
SR
Factor 1
Factor 2
SP
SR
0.297
0.045
0.504
0.170
0.668
0.132
0.607
0.108
0.368
0.233
0.257
0.056
0.313
0.062
0.448
0.216
0.652
0.181
0.380
0.301
0.438
0.367
0.135
0.094
0.533
0.094
0.287
0.088
0.638
0.046
0.335
0.183
0.422
0.055
0.655
0.224
0.543
0.091
0.640
0.123
0.345
0.148
0.495
0.027
0.283
0.151
0.062
0.478
0.099
0.472
0.030
0.476
0.173
0.282
0.282
0.574
0.156
0.654
0.266
0.529
0.001
0.439
0.241
0.454
0.073
0.543
0.221
0.258
0.210
0.541
0.014
0.509
0.082
0.354
0.044
0.528
0.214
0.096
0.037
0.147
0.240
0.285
0.065
0.560
0.051
0.294
0.268
0.512
0.379
0.527
0.383
0.526
Factor 1
Factor 2
Factor 3
0.410
0.168
0.014
0.597
0.183
0.204
0.010
0.116
0.512
0.719
0.412
0.556
0.515
0.388
0.218
0.565
0.330
0.113
0.165
0.297
0.163
0.328
0.047
0.154
0.320
0.144
0.155
0.041
0.139
0.090
0.120
0.007
0.172
0.052
0.202
0.012
0.307
0.067
0.174
0.132
0.122
0.146
0.541
0.121
0.254
0.266
0.121
0.149
0.524
0.083
0.586
0.163
0.602
0.012
0.132
0.065
0.048
0.263
0.072
0.083
0.248
0.095
0.790
0.187
0.505
0.395
0.414
0.247
0.131
0.086
0.344
0.093
0.272
0.092
0.614
0.098
0.203
0.131
0.315
0.026
0.731
0.256
0.329
0.054
0.530
0.007
0.217
0.006
0.281
0.105
0.225
0.145
0.008
0.591
0.079
0.093
0.033
0.299
0.010
0.254
0.003
0.143
0.089
0.231
0.020
0.193
0.340
0.148
0.044
0.253
0.281
0.207
0.258
0.152
0.014
0.396
0.159
0.364
0.212
0.143
0.196
0.771
0.176
0.131
0.100
0.150
0.003
0.244
0.235
0.383
0.082
0.109
0.143
0.482
0.165
0.777
0.295
0.516
Factor 4
0.222
0.151
0.044
0.053
0.021
0.093
0.008
0.201
0.041
0.044
0.025
0.117
0.020
0.200
0.406
0.384
0.184
0.201
0.079
0.153
0.012
0.004
0.435
0.140
0.058
0.220
0.208
0.306
0.085
0.302
0.598
0.421
0.060
0.412
0.099
0.216
0.311
0.286
0.101
0.537
0.645
0.288
0.000
0.340
0.063
0.071
(continued
Uniqueness
0.499
0.322
0.437
0.336
0.241
0.444
0.345
0.546
0.319
0.251
0.585
0.343
0.381
0.373
0.377
0.361
0.295
0.516
0.359
0.450
0.373
0.456
0.439
0.420
0.339
0.331
0.528
0.525
0.288
0.253
0.377
0.347
0.443
0.395
0.334
0.431
0.336
0.385
0.394
0.377
0.273
0.345
0.254
0.213
0.412
0.333
on next page)
996
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
Table 4 (continued)
Variable
Item 47
Item 48
Scale
Factor 1
Factor 2
SP
SR
Factor 1
Factor 2
Factor 3
Factor 4
Uniqueness
0.203
0.468
SP
SR
0.682
0.080
0.185
0.511
0.153
0.172
0.624
0.093
0.150
0.336
0.214
0.157
Factor 2
Factor 3
Factor 4
0.286**
1
–
–
0.369**
0.268*
0.247*
1
0.049
0.000
1
0.347**
1
–
–
Loadings greater than 0.400 are in bold.
*
p < 0.01.
**
p < 0.001.
the two SP first-order factors. The RR factor fails to load. These factors moderately correlate at
+0.273 (p < 0.002).
4. Discussion
We translated the BIS/BAS scales and the SPSRQ into French and studied their psychometric
properties in a sample of students (more than 90% were under 30 years old). Overall we obtained
satisfactory results in line with the literature. Females scored higher than males on BIS, and no effect of age was found on any score. Their reliability is good, except for DRIVE in males due to a
near zero correlation of item 9 with the rest of the test. The observed intercorrelation pattern between scores was expected, except for the significant BIS-SR and BIS-RR correlations in females.
The size of our sample (N = 144 for the BIS/BAS and N = 136 for the SPSRQ) might be a limitation of this study, especially with regard to the EFAs. In fact, necessary sample size is dependent on several aspects of any given study and is not invariant across studies (MacCallum,
Widaman, Zhang, & Hong, 1999). The median communality of the BIS/BAS items is 0.50 (range
0.08–0.79) and the variable to subject ratio is 1/7.20; for the SPSRQ 0.30 (range 0.11–0.77) and 1/
2.83, respectively. Nevertheless, since the SPSRQ counts a small number of overdetermined factors the issue of sample size remains open, and calls for replication studies. A sample of at least
200 subjects of each gender would be desirable, and would additionally allow testing the crossgender structural and measurement invariances of these instruments within a CFA framework.
As Carver and White (1994) showed for their BIS/BAS scales and what was hypothesized for
the GWPQ, our results tend to support a two-order structure for the SPSRQ too. The higher-order factors presumably represent the two brain/behavioural systems postulated by Gray. For
identification purposes, we showed that the eight primary factors define a two-factor space. Nevertheless, both instruments present weaknesses at the primary level; the uniqueness values suggest
that there is room for additional factors and may explain why CFA analyses have failed so far.
Consistent with studies on English-speaking samples, BIS correlates with RR (e.g. Carver &
White, 1994; Heubeck et al., 1998). Indeed, RR items do not measure a reliable factor, and items
7, 14 and 18 load on other primary factors. This is in line with an IRT study that found serious
limitations in the RR scale (Gomez, Cooper, & Gomez, 2005). Finally, Carver and White (1994)
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
997
reported a nice two-order structure after factoring the scale scores, not the factor scores as we did.
This may also explain why all CFA studies failed but the one that used item parcelling (Leone
et al., 2001).
With regard to the SPSRQ, the patterns of loadings are similar between our oblique two-factor
solution and Torrubia et al.’s (2001) orthogonal two-component solution: two thirds of the items
loaded above 0.400, and eleven out of the 16 items remaining also loaded poorly in the original
study (1, 9, 11, 13, 19, 23, 28, 32, 34, 36, and 40). In passing, this suggests that the polytomic item
format did not harm our factor analyses. One could recommend simply discarding these items to
achieve a better measurement, but we would not since a four-factor solution seems more advantageous. Admittedly, six items (8, 22, 27, 28, 36 and 45) still loaded poorly in both our solutions.
On the other hand, nine items (1, 9, 11, 13, 19, 32, 34, 40, 41) loaded poorly on the two-factor
solution but loaded on their expected primary factor in the four-factor solution. Also, SP items
23 and 31 loaded poorly on the two-factor solution but loaded on a SR primary factor in the
four-factor solution. Therefore, constraining a two-factor solution probably may not reflect properly the true underlying structure of the SPSRQ. Confirmatory factor analyses and convergent/
divergent validity studies in independent larger samples are now needed. The point is that more
factors are needed to reliably measure the constructs postulated by RST.
In conclusion, regardless of language, both the BIS/BAS scales and the SPSRQ need structural
refinements to achieve a better measurement of the underlying constructs. A psychometrically
sound instrument for reflecting the FFS in human personality is also pending to conform to
the latest version of RST.
References
Ball, S. A., & Zuckerman, M. (1990). Sensation seeking, Eysenck’s personality dimensions and reinforcement sensitivity
in concept formation. Personality and Individual Differences, 11, 343–353.
Bollen, K. A., & Barb, K. H. (1981). Pearson’s r and coarsely categorized measures. American Sociological Review, 46,
232–239.
Carver, C. S., & White, T. L. (1994). Behavioral inhibition, behavioral activation, and affective responses to impending
reward and punishment: the BIS/BAS scales. Journal of Personality and Social Psychology, 67, 319–333.
Caseras, X., Avila, C., & Torrubia, R. (2003). The measurement of individual differences in behavioural inhibition and
behavioural activation systems: a comparison of personality scales. Personality and Individual Differences, 34,
999–1013.
Cogswell, A., Alloy, L. B., van Dulmen, M. H. M., & Fresco, D. M. (2006). A psychometric evaluation of behavioral
inhibition and approach self-report measures. Personality and Individual Differences, 40, 1649–1658.
Corr, P. J. (2001). Testing problems in J.A. Gray’s personality theory: a commentary on Matthews and Gilliland (1999).
Personality and Individual Differences, 30, 333–352.
Corr, P. J. (2002). J.A. Gray’s reinforcement sensitivity theory: tests of the joint subsystems hypothesis of anxiety and
impulsivity. Personality and Individual Differences, 33, 511–532.
Gomez, R., Cooper, A., & Gomez, A. (2005). An item response theory analysis of the Carver and White (1994) BIS/
BAS scales. Personality and Individual Differences, 39, 1093–1103.
Gray, J. A., & McNaughton, N. (2003). The neuropsychology of anxiety: an enquiry into the functions of the septohippocampal system. London: Oxford University Press.
Heubeck, B. G., Wilkinson, R. B., & Cologon, J. (1998). A second look at Carver and White’s (1994) BIS/BAS scales.
Personality and Individual Differences, 25, 785–800.
998
H. Caci et al. / Personality and Individual Differences 42 (2007) 987–998
Jackson, C. J., & Smillie, L. D. (2004). Appetitive motivation predicts the majority of personality and an ability
measure: a comparison of BAS measures and a re-evaluation of the importance of RST. Personality and Individual
Differences, 36, 1627–1636.
Lance, C. E., Butts, M. M., & Michels, L. C. (2006). The sources of four commonly reported cutoff criteria. What did
they really say? Organizational Research Methods, 9, 202–220.
Leone, L., Perugini, M., Bagozzi, R. P., Pierro, A., & Mannetti, L. (2001). Construct validity and generalizability of the
Carver–White behavioural inhibition system/behavioural activation system scales. European Journal of Personality,
15, 373–390.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological
Methods, 4, 84–99.
Müller, J. M., & Wytykowska, A. M. (2005). Psychometric properties and validation of a Polish adaptation of Carver
and White’s BIS/BAS scales. Personality and Individual Differences, 39, 795–805.
O’Connor, R. M., Colder, C. R., & Hawr, L. W. Jr., (2004). Confirmatory factor analysis of the sensitivity to
punishment and sensitivity to reward questionnaire. Personality and Individual Differences, 37, 985–1002.
Ross, S. R., Millis, S. R., Bonebright, T. L., & Bailley, S. E. (2002). Confirmatory factor analysis of the behavioral
inhibition and activation scales. Personality and Individual Differences, 33, 861–865.
Torrubia, R., Avila, C., Molto, J., & Caseras, X. (2001). The sensitivity to punishment and sensitivity to reward
questionnaire (SPSRQ) as a measure of Gray’s anxiety and impulsivity dimensions. Personality and Individual
Differences, 31, 837–862.
Wilson, G. D., Gray, J. A., & Barrett, P. T. (1990). A factor analysis of the Gray–Wilson personality questionnaire.
Personality and Individual Differences, 11, 1037–1045.