Theme 6 Time Series and Autocorrelation Lecture Notes
Theme 6 Time Series and Autocorrelation Lecture Notes
What is then the main difference between cross-sectional data and time series ?
Ø Time series data has a temporal ordering, unlike cross-section data.
Ø It is still valid that economic time series still satisfy the intuitive requirements of
random variables, however as an example, today we cannot predict precisely we can
only have speculations about what the Dow Jones Industrial average will be at the
closure of the trading session.
Ø Since outcomes are not foreknown, they should be clearly stated as random variables.
Ø A sequence of random variables in time series are known as stochastic process.
yt = b0 + b1xt + . . .+ bkxtk + ut
6.1.1 Classification of Time series Models Static Model :
static model is driven from the fact that a contemporaneous relationship is being modelled
between z and y and 𝑦! and 𝑧! , where both are dated contemporaneously .
Ø A type of model under time series when one or more variables are allowed to
affect y with a lag using the following annual observations for example:-
Ø 𝛿$ the impact propensity – it reflects the immediate change in y.
Ø Do you see the the difference between GLS 95% interval and OLS 95%
interval
Ø It could be misleading in hypothesis testing and significance of relationship
between variables.
Ø The message is: To establish confidence intervals and to test hypotheses, one
should use GLS and not OLS even though the estimators derived from the
latter are unbiased and consistent.
6.5 Detecting Autocorrelation
I. Graphical Method
Ø We can simply plot error against time, the time sequence plot, which shows the residuals
obtained from the log wages–productivity regression.
Ø plot the standardized residuals against time, which is (𝑢!& ) divided by the standard error of the
regression (σˆ), that is, they are (𝑢!& /σˆ).
Figure 6.3 Residuals (magnified 100 times) and standardized residuals from the wages–productivity
regression.
both 𝑢!& and the standardized 𝑢!& exhibit a pattern suggesting that perhaps 𝑢! 𝑖𝑠 𝑛𝑜𝑡 random and
autocorrelation might exist
6.5.1 Detecting Autocorrelation
[Graphical Plot Durbin Watson– Breusch Pagan]
guj75772_ch12.qxd
14/08/2008 10:40 AM Page 429
Recall that the assumption of nonautocorrelation of the classical model relates to the pop-
ulation disturbances u t , which are not directly observable. What we have instead are their
proxies, the residuals û t , which can be obtained by the usual OLS procedure. Although the
count both autocorrelation and heteroscedasticity, provided the sample is reasonably large.
As expected, the income and wealth elasticities are positive and the interest rate semielastic-
ity is negative. Although the estimated coefficients seem to be individually highly statistically
significant, we need to check for possible autocorrelation in the error term. As we know, in the
Ø Allpresence
signs of coefficients are
of autocorrelation, pro-intuitive
the estimated to errors
standard the literature findings and
may be underestimated. main
Examing
theoretical review as wealth and income are +vely related to consumption, however,
interest
47
Lois W.rates
Sayrs,have
Pooled a -veSeries
Time relatioship with
Analysis, Sage consumption.
Publications, California, 1989, p. 19.
Ø 48
All variables are highly significant at p-values lessand
See Jeffrey M. Wooldridge, op. cit., pp. 402–403, and A. K. Bera than 0.05
C. M. Jarque, “Efficient Tests
for Normality, Homoscedasticity and Serial Independence of Regression Residuals: Monte Carlo
Ø The overallEconomic
Evidence,” goodness
Letters,of
vol.fit of the
7, 1981, model is impressive with a 0.99 R^2
pp. 313–318.
Ø Durbin Watson autocorrelation indicator is too low,which might raise doubts about
the validity of results and presence of serial correlation and autocorrelation.
Ø Test the presence of serial correlation between wealth and income as the residuals of
both variables might be correlated.
Ø Take AR(1) lags first difference of variables and MA(1) of residuals to make sure
they are not auto correlated.
Ø
6.6 Stationary Vs. Non-Stationary Time Series
Ø Stationary Process: it is one whose probability distribution over time is stable and
any sample of random variables chosen from this population, will show the
characteristics of a normal distribution and it does follow a normal stochastic process
without a deterministric trend or a random walk.
Ø Thus, stationarity implies that the xt’s are identically distributed and that nature.
of any correlation between adjacent terms is the same across all periods.
Example the joint distribution of (𝑥# , 𝑥' )for the two terms in sequence must be the same as
the joint distribution of (𝑥! , 𝑥!(# ) for any t >=1 and it has nothing to do with correlation
between variables or correlation between variables across time periods
6.6.1 Random Walk known by highly persistent time series
Ø A random walk is an AR(1) model where r1 = 1, meaning the series is not weakly dependent
Ø Note that trending and persistence are different things – a series can be trending but weakly dependent, or a
series can be highly persistent without any trend.
Ø A random walk with drift is an example of a highly persistent series that is trending.
Random Walk needs to be treated doesn’t thoroughly predict relationship of yt is consistent over time as
Variance of the time series increases over time and this violates stationarity/ CHAPTER 11 Further Issues in Using OLS with Time Series Data 395
394 PART 2 Regression Analysis with Time Series Data
8 50
Test for a unit root with drift: ∆yᵢ = a₀ + δyᵢ₋₁ + uᵢ and shrinking over time if 0
we can show that E( yt h yt)
0. By reasoning as we did in the pure random walk case,
0h yt, and so the best prediction of yt h at time t is yt plus
United States. If GDP is asymptotically uncorrelated, then the level of GDP in the coming the drift 0h. The variance of yt is the same as it was in the pure random walk case.
year is at best weakly related to what GDP was, say, 30 years ago. This means a policy Figure 11.3 contains a realization of a random walk with drift, where n 50, y0 0,
that affected GDP long ago has very little lasting impact. On the other hand, if GDP is 0 2, and the et are Normal(0, 9) random variables. As can be seen from this graph, yt
strongly dependent, then next year’s GDP can be highly correlated with the GDP from tends to grow over time, but the series does not regularly return to the trend line.
many years ago. Then, we should recognize that a policy that causes a discrete change in A random walk with drift is another example of a unit root process, because it is the
GDP can have long-lasting effects. special case 1 1 in an AR(1) model with an intercept:
It is extremely important not to confuse trending and highly persistent behaviors.
yt 1yt et.
A series can be trending but not highly persistent, as we saw in Chapter 10. Further, factors 0 1
Ø
where {e : t
t
At levels and at default lags
1, 2, …} and y satisfy the same properties as in the random walk model.
0
What is new is the parameter , which is called the drift term. Essentially, to generate y , the
0 t
lated. We will study the spurious regression problem in more detail in Chapter 18, but
for now we must be aware of potential problems. Fortunately, simple transformations are
constant 0 is added along with the random noise et to the previous value yt 1. We can show available that render a unit root process weakly dependent.
that the expected value of yt follows a linear time trend by using repeated substitution:
The Correlogram
y ist shown
e et
here.
… There
e y . are three
0 t t 1 1 0
main parts:
ØAutocorrelation (AC) – this is the
correlation coefficient for values of
the series k-periods apart. If the value
of the first AC is non-zero, it means
that the series is first-order serially
correlated. If autocorrelation dies off
geometrically as k increases, this is a
sign of low-order AR process. If
autocorrelation drops to 0 after a
small number of lags, this is a sign of
low-order MA process
The partial correlation at lag k is the coefficient of the regression of Xt on a constant and
all lags of X up to k. If the partial correlation at lag k is close to 0, this means that
autocorrelation is of the order less than k
6.6.3 Correlogram is used to test stationarity of GDP
Unit Root test conducted
Steps to followed:-
1) View
2)Choose unit root test
To check if lGDP series is
stationary or not leave it at levels
It is insignificant , we cannot reject that GDP has a unit root
and it is non-stationary
3) In order to treat for this problem of stationarity, we test unit
root at 1st difference
4) View- unit root test – choose
This time taking 1st difference
The p value is significant thus we reject the non- stationarity
and series of GDP was transformed to a stationary one.
Ø It is essential to know whether a time series follows a unit root process denoted by
I(1) or not. If the data has a unit root process means it is non-stationary and there is
shock that has a permanent effect on the data and the normal AR(q) or MA(p) order
and other processes cannot be applied normally, some transformation needs to be
done.
Ø The simple approach to testing for a unit root with an AR(1) model where:
Ø 𝒚𝒕 =𝜶 + 𝝆𝒚𝒕*𝟏 +𝒆𝒕 ,t=1,2…..,
6.6.5 Example: Unit Root test for annual inflation
Using the annual data for U.S. inflation, based on the CPI to test for a unit root in inflation
Restricting the data to years 1948- 1996 allowing for one and two lags of ∆ "#$! in the augemented Dickey-Fuller
regression It is tested via: -
- Augemented Dickey-Fuller (DF) test for a unit root
(large large samples)
- Phillips –Perron Test rotbust to robust to issues like
∆"#$"! =1.36 -3.10"#$!#$ +1.38∆"#$!#%
autocorrelation and heteroskedasticity and used for
(.517) (.103) (.126)
small samples.
n=47, %% =.172
- KPSS Test where Ho is a trend stationarity
rather than unit root
- ADF-GLS test uses GLS increases efficiency
Unit root test is needed to demonstrate whether the inflation series and CPI
are Stationary or non-stationary and have a unit root
Steps
At level Intercept
At first difference Trend+ intercept
At Second difference None
6.6.6 Analysis of Time series Correlogram
Correlogram: Example 2
1. Open the lGDP series in the
TimeSeries workfile page.
2. Click View → Correlogram.
3. The Correlogram Specification
box opens up. Select 1st Difference
under Correlogram of section.
4. Under Lags to Include section,
type the number of lags (36)
5. Click OK
It is seen, that the autocorrelation pattern is less pronounced for 1st differences relative to levels,
as they show normal stochastic oscillations and no decaying trend as before.
(c) (a)
UsePlotthe data toagainst
the sequence verify the
time. results
Does given
the series appearbelow.
to be stationary?
(b) Indicate if the series is not stationary which tests will be conducted first and then how
1 PACF results in Enders (2004) are derived using the Yule-Walker method. The default in EVIEW
could it be made stationary.
option. Thus you may find considerable differences in the default values of the PACF calculated
given in Enders (2010).
II) Design a Financial Application using time series data
Objective: To create a basic investment strategy that relies on historical monthly average
returns to inform investment decisions.
Components:
Historical Monthly Returns: Utilize time series data for monthly returns of a financial
asset.
Average Monthly Return:Calculate the average monthly return over a specified historical
period.
Investment Decision Rule:If the current month's return is above the average, consider it a
positive signal.If the current month's return is below the average, consider it a negative
signal.
Position Management: Execute buy orders when the current month's return is above the
average.Execute sell orders when the current month's return is below the average.
Risk Management: Implement a simple risk management rule, such as setting a maximum
allowable portfolio loss for each trade.
This simplified strategy is based on the premise that if the current month's return is
consistently above (or below) the historical average, it may indicate a trend that can be
exploited for investment decisions.
The regression model for this simple strategy could be represented as: