PSYRATS Erna Erawati
PSYRATS Erna Erawati
PSYRATS Erna Erawati
Author Affiliations
Erna Erawati, MN
Lecturer at Polytechnic of Health Semarang, Programmed Diploma of Nursing in
Magelang, Central Java, Indonesia
Author contributions
EE, BAK was responsible for the study conception and design. EE, BAK, NH was
responsible for the drafting of the manuscript. BAK made critical revisions to the paper for
important intellectual content. NH provided statistical expertise. EE, BAK, NH provided
administrative, technical and material support. BAK, NH supervised the study.
Funding
This work was supported by a donation DIPA (Daftar Isian Perencanaan Anggaran)
Polytechnic of Health Semarang, Central Java
Conflict of interest
None
Abstract
Aim: The present study was to validate the Indonesian version of Psychotic Symptoms
Ratings Scales (PSYRATS), the Cognitive Bias Questionnaire for Psychosis (CBQp) and
the Metacognitive Ability Questionnaire (MAQ) as a new scale to measure the ability of
metacognition of schizophrenia.
Background: The PSYRATS, CBQp, and MAQ have demonstrated their usefulness for
the assessment of hallucinations and delusions, cognitive biases and metacognitive
ability in schizophrenia. So far no validation of the Indonesian version has been carried
out.
Methods: The PSYRATS, CBQp and MAQ were administered to 155 subjects with a
diagnosis of schizophrenia. Factor structure, reliability, test-retest stability, and
convergent validity were analyzed.
Findings : We found that the all psychometric were reliable and valid. Indonesian version
of the PSYRATS and CBQp Indonesian version have high reliability. The reliability of new
psychometric of MAQ was Cronbach’s alpha=.759 and was checked in a subsample
(n=32; r=.668; p<.01).
Conclusions: Similar to the original PSYRATS and CBQp, the Indonesian PSYRATS and
CBQp have good psychometric properties.The new psychometric of MAQ is a valid
instrument for assessing metacognition. Implications for future research are discussed.
Keywords:
Schizophrenia; Hallucination severity; delusion severity; Bias cognitive for psychosis;
Metacognition:Instrumental study.
SUMMARY STATEMENT
Accessible Summary
The Psychotic Symptoms Ratings Scales (PSYRATS) Indonesian version is a
good and sensible psychometric to asses hallucination and delusion severity as
positive symptoms in schizophrenia.
Cognitive biases involved in the pathogenesis of schizophrenia. Therefore
Cognitive Bias Questionnaire for Psychosis (CBQp) Indonesian version as valid
and reliable instruments is needed to measure cognitive biases such as jump to
conclusion (JTC), intentionalising, catastrophising, emotion-based reasoning and
dichotomous thinking.
The Metacognitive Ability Questionnaire (MAQ) as a new instrument could be
used in assesing the metacognition of schizophrenia patients so that they can
minimized their own cognitive bias.
Due to the wide range of schizophrenia symptoms, studies of this disorder have used
multiple symptomatology scales designed to evaluate the disorders. The use of several
different scales gives an indirect assessment of schizophrenia symptoms. However, more
recently, several hallucination and delusion scales based on DSM-IV criteria have been
developed to increase accuracy of the diagnosis and decrease the time needed to
perform the assessment. Clinician-administered rating scales commonly used in inpatient
hospital settings include the Psychotic Symptom Rating Scales (PSYRATS; Haddock,
1999), the Positive and Negative Symptom Scale (PANSS; Kay, Fiszbein, & Opler, 1987),
the Brief Psychiatric Rating Scales (BPRS; Overall & Gorham, 1962), the Schedule for
the Assesment of Negative Symptoms (SANS; Andreasen, 1982a) and the Schedule for
the Assesment of Positive Symptoms (SAPS; Andreasen, 1982b). Differences between
these scales mainly involve administration time, time-frame considered, and the number
of items used to assess each criterion. Despite the good psychometric properties of these
clinician-administered instruments, they all have certain disadvantages, such as a need
for clinical expertise to perform the assessments.
Several instruments have been created to assess schizophrenia diagnosis and severity in
the Indonesian population. However, no validated self-report measures are yet available
to specifically assess hallucination, delusion severity, bias cognitive and metacognitive
ability. For this reason, the aim of the present study was to validate the Indonesian
language version of the PSYRATS, CBQP, and MAQ in a sample of subjects with
schizophrenia diagnosis. The psychometric properties of Indonesian version of the
PSYRATS, CBQP, and MAQ.
Methods
In an Indonesian sample of 155 patients diagnosed with schizophrenia were interviewed
twice during the course of two months using a newly developed Indonesian version of the
PSYRATS, CBQp and MAQ with very good psychometric properties. Our design adopted
factor structure, reliability, test-retest stability.
This study was approved by the Clinical Research Ethics Committee at the Ghrasia
Mental Hospital Jogjakarta and carried out in accordance with the Declaration of Helsinki.
Participants were given a detailed description of the study and gave their written informed
consent.
Participants
The total sample consisted of 155 subjects with schizophrenia recruited from
mentalhealth settings in Indonesian public institutions. According to Nunnally (1978) the
sample size was considered appropriate taking into account psychometric
recommendations that suggest 5 to 10 individuals per item. Inclusion criteria consisted of
schizophrenia diagnosis fulfilling Diagnostic and StatisticalManual of Mental Disorders,
fourth edition (DSM-IV) (APA, 2000) and age between 18 and 65 years. Exclusion criteria
were as follows: co morbidity with bipolar disorder, current major depressive disorder,
substance dependence, and severe difficulties in reading comprehension. All participants
had to be native Indonesian speakers.
There were 155 schizophrenia patients with delusions and hallucination in our mental
hospital during May- July 2012. Of these, all met the criteria for delusions and
hallucination score using PSYRATS.
Results
Patient Demographics
The socio-demographic and background characteristics of patients were analyzed
usingunivariateanalysisand cross table statistics. Schizophrenia clients in this research
were 35 years old on average. Most of the schizophrenia clients were male (54.19%).
These and other characteristics are summarized in Table 1. Note that the patient did
not differ significantly on any variable at baseline.
The Indonesian version of the PSYRATS replicates the original version. The PSYRATS-
Hallucination subscale has high reliability (Cronbach’s alpha=.741), as well as good test-
retest stability, which was checked in a subsample (n=31; r=.791; p<.01). The Indonesian
version of the PSYRATS-delusion subscale replicates the original version has high
reliability (Cronbach’s alpha=.801), as well as good test-retest stability, which was
checked in a subsample (n=31; r=.637; p<.01). The Indonesian version of the CBQP
replicates the original version. The scale has high reliability (Cronbach’s alpha=.722), as
well as good test-retest stability, which was checked in a subsample (n=92; r=.664;
p<.01). The Indonesian version MAQ reliability (Cronbach’s alpha=.759), as well as good
test-retest stability, which was checked in a subsample (n=32; r=.668; p<.01). PSYRATS
has shows moderate to high correlations with MAQ. The PSYRATS is able to
discriminate among different levels of delusion and hallucination severity.
Data analysis
Data analysis was carried out using SPSS 18.0 statistical software for Windows.
Descriptive statistics were used to describe the demographic and clinical characteristics
of the sample. An exploratory factorial analysis (EFA) of principal components with a
Varimax rotation was performed to examine the factorial structure of the scale. It was
used Confirmatory Factor Analysis (CFA) to explore the goodness of fit of the original
one-factor structure of the PSYRATS Indonesian version, CBQp Indonesian version, and
MAQ. EQS software for Windows version 6.1 was used to conduct the CFA. The
maximum likelihood with robust correction method was used to adjust for distributional
problems in the data set. Although a model with a non-significant chi-square estimate is
generally considered a model with good fit, Hu and Bentler recommended combinational
rules to evaluate model fit. The following criteria were used to indicate the fit of the CFA
models to the data: CFI (Comparative Fit Index) and GFI (Goodness of Fit Index) >.90
and RMSEA (Root Mean Square Error of Approximation) <.08. Values for CFI and GFI
ranged from 0 to 1. These fit statistics and the chi-square were selected because
previous research has demonstrated their performance and stability.
To test internal consistency, Cronbach’s alpha was estimated and the split-half method
was also applied. In addition, Cronbach’s alpha was estimated with each of the items
removed one at a time from the scale. Test-retest reliability and convergent validity were
evaluated by correlation analysis.
Discussion
Psychotic Rating Scale (PSYRATS) is a golden standard in measure delusion and
hallucination severity on schizophrenia. Haddock et al (1999) PSYRATS have two
independent subscales, eleven characteristics of hallucinations and six characteristics of
delusions are assessed using an item-specific anchored five-point rating system. In the
auditory hallucinations subscale (PSYRATS-AH) hallucinations are rated for example in
regard to their frequency, location, loudness, and disruption to life. The delusions
subscale (PSYRATS-DS) includes for example items concerning the amount and
duration of preoccupation with delusions or amount and intensity of distress. The ratings
are based on the patients' experiences during the previous week. In particular, the
separate assessment of the dimension of the personal distress linked to symptoms is a
major advantage of the PSYRATS. Using a likert scale (0-4), the range score of delusion
subscale is 0-24, whereas the range score of hallucination subscale is 0-44. If the score
is smaller, then there will be a decline of the symptom.
The CBQp was related to hallucinations, delusions and depression, and there was
preliminary evidence that it is sensitive to change following CBTp. None of the biases
were related to existing experimental tasks, suggesting the CBQp measures a different
construct. The research conducted by Jasper, et al (2010) to 30 respondents show that
the CBQp has good psychometric properties andthe 5 biases were highly correlated with
each other, although confirmatory factor analysis showed equal goodness of fit indices for
1-factor and 5-factor scales. Another research showed that the CBQ-P and DACOBS
appear to be psychometrical sound instruments to assess general thinking bias in
psychosis within a Flemish population (Bastiaens, et al, 2013).
Metacognitive Ability Questionnaire (MAQ) is a reliable and valid self-report instrument for
assessing the metacognition awareness on schizophrenia. MAQ is a 29- items subjective
metacognition scale designed to measure metacognitive ability. Each item is
quantitatively assessed on a 4-point Likert scale that ranges from 0 (rare) to 3 (often). It
reflects the goal of each MCT session and consisted of three component of metacognitive
skills pertaining to cognition, affect and behavior. If the score is higher, then there will be
an increasing of the ability of metacognition.
Conclusions
To conclude, the Indonesian PSYRATS is a reliable instrument for assessing and
discriminating hallucination and delusion severity in Indonesian population. Moreover,
administration-time is brief and it is suitable for use in both research and clinical settings.
Also, CBQpis good psychometric to asses cognitive bias for psychosis and MAQ is a
valid and reliable instruments to measure metacognitive ability in Indonesian population.
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
EE conceived the study aims and design, and developed the study in discussions with
BK, NH. EE performed the analysis and drafted the initial manuscript. All authors
contributed to interpretation of results, revised and commented on the manuscript for
important intellectual content. All authors read and approved the final manuscript.
References
1. American Psychiatric Association (APA). (2000). The diagnostic and statistical
manual of mental disorders: DSM-IV-TR. Washington D.C: American Psychiatric
Association.
2. Andreasen NC. (1984). Scale for the assessment of positive symptoms (SAPS). Iowa
City, Iowa: University of Iowa.
5. Bentler PM. (1995). EQS structural equations program manual. Encino, CA:
Multivariate Software.
8. Haddock, G., McCarron, J., Tarrier, N., Faragher, E.B. (1999). Scales to measure
dimensions of hallucinations and delusions: the psychotic symptom rating scales
(PSYRATS). Psychological Medicine 29, 879–889.
9. Hu LT, Bentler PM. (1999). Cut-off criteria for fit indexes in covariance structure
analysis: conventional criteria versus new alternatives. StructEqu Modeling. 6:1-55.
Publisher Full Text
10. Bentler PM, Bonett DG. (1980). Significance tests and goodness of fit in the analysis
of covariance structures. Psychol Bull. 47:541-570.
12. Kay, S.R. & Fiszbein, A. (1987). The positive and negative syndrome scale (PANSS)
for schizophrenia. Schizophrenia Bulletin, 13, 261-275
16. Moritz, S., Veckenstedt, R., Bohn, F., Hottenrott, B., Scheu, F., Randjbar, S.,
Aghotor, J., Köther, U., Woodward, TS., Treszl, A., Andreou, C., Pfueller, U., Roesch-
Ely, D. (2013). Complementary Group Metacognitive Training (MCT) reduces
delusional ideation in schizophrenia. Schizophrenia Research
17. Moritz, S., Veckenstedt, R., Bohn, F., Köther, U.F., Woodward, TS. (2013).
Metacognitive Training in Schizophrenia Theoretical Rationale and Administration. In
David L. Roberts & David L. Penn (Eds.), Social cognition in schizophrenia : from
evidence to treatment.( Chapter 15). New York: Oxford University Press
18. Overall, J.E. & Gorham, D.R. (1962).The Brief Psychiatric Rating Scale.
Psychological reports, 10, 790-81
Table 1
Sociodemographic variables at baseline
Variables (n=155)
Background
Sex (male/female) 84/71
Age in years 35.68(12.36)
Educational background
Elementary School 24
Yunior high School 34
Senior high school 68
College 29
Working status
Student 10
Civil worker 8
Entrepreneur 82
Unemployee 55
Marriage status
Married 57
Divorce 20
Not married 78
Ever had trauma in the past
Yes 143
No 12
Mental disorder history in
family
Yes, there is 40
None 115
Ever been hospitalized with
mental disorder
Never 35
Ever 120