Wiley, Accounting Research Center, Booth School of Business, University of Chicago Journal of Accounting Research
Wiley, Accounting Research Center, Booth School of Business, University of Chicago Journal of Accounting Research
Wiley, Accounting Research Center, Booth School of Business, University of Chicago Journal of Accounting Research
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted
digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about
JSTOR, please contact support@jstor.org.
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
Enforcement of Accounting
Standards, and Analysts' Forecast
Accuracy: An International Study
PETER F. POPE*
1. Introduction
Hope's study reports new evidence on the links between the accuracy of
analysts' earnings forecasts and international accounting differences. The
focus of the analysis is on differences in annual report disclosures and in
the enforcement of accounting standards. He relates the CIFAR index of
the level of annual report disclosure and self-constructed indexes of enforcement to forecast accuracy for a sample of 1,553 firm-years from 22 countries.
The study provides new insights on the links among equity market expectations, the information environment, and the institutional context of financial reporting. In a world with significant institutional differences between
countries, understanding of these links is potentially important for regula-
Early international accounting research associated differences in accounting principles and measurement with characteristics of the financial reporting environment such as managerial philosophy, the legal system, the development of equity and debt markets, tax law, and the governance model (e.g.,
*Lancaster University.
273
Copyright ?, University of Chicago on behalf of the Institute of Professional Accounting, 2003
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
274 P. F. POPE
A small number of recent studies directly examine attributes of financial statement quality in an international comparative setting. Ball, Kothari,
and Robin [2000], Ball, Robin, and Wu [2002], and Fan and Wong [2001]
document significant international variation in the degree of asymmetric
timeliness of earnings with respect to bad news and good news. They explain these differences with reference to institutional features of the finan-
both asymmetric timeliness of earnings and earnings management are potentially important in explaining the ability of stock market participants to
forecast earnings.
Basu, Huang, and Jan [1998] (hereafter, BHJ) study a further aspect of
comparative international accounting differences. They document significant country-level differences in earnings volatility and predictability. They
associate these differences with variation in accounting principles, including the extent of accrual accounting, the extent of the use of historical cost
versus market or fair value accounting, and the degree of accounting choice.
BHJ also consider the influence of country-level disclosure differences on
earnings variability and predictability.
Hope's study of the determinants of forecast accuracy is most closely related to BHJ's study. It is similar in that both studies employ the accuracy
of analysts' earnings forecasts as a criterion for comparing accounting systems. It differs from BHJ in that the analysis of disclosure effects is at the
firm level and because it considers the relation between forecast accuracy
and enforcement, based on both country-level and firm-level information.
To my knowledge, prior empirical research has not attempted to examine
directly the effects of enforcement differences on the usefulness of financial
statements.
associated with the level of annual report disclosure, consistent with the
country-level analysis in BHJ. Also, the positive association between forecast accuracy and disclosure is more pronounced when analyst following is
low. With regard to enforcement, Hope shows that the forecast accuracy is
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
positively associated with enforcement, especially when the estimated degree of accounting choice available in a country is high.
Hope's study represents a very significant research effort. It has required
the collection and consolidation of data from a wide number of electronic
and hard-copy sources. The author has also invested considerable effort in
developing a quantitative index of enforcement, in validating the disclosure index, and in examining the robustness of results to alternative measurement definitions. Much of the conference discussion focused on the
existence of various disclosure items could be expected to enhance forecasting ability. Some of the disclosure items affecting CIFAR scores might
well be considered irrelevant in this context (e.g., frequency of dividend
payments, board members, and affiliations).
There was also interest during conference discussion in the enforcement
measure used in the study. Hope argues that enforcement of accounting
standards will reduce accounting uncertainty and accounting fraud, thus
making forecasting easier. The country-level enforcement measure employed by Hope aggregates information on five main aspects of the regulatory environment surrounding financial reporting using factor analysis:
audit spending, insider trading regulation, judicial efficiency, rule of law,
and antidirector rights. The alternative measure uses firm-specific data on
stock exchange listings and audit firm type in place of audit spending. Hope
accepts that interpretation of the enforcement measures is controversial. In
relation to the components of the country-level enforcement measure, audit
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
276 P. F. POPE
the enforcement measures developed in the study. But what lessons can
we take away from these results, particularly with regard to international
accounting differences? In the remainder of this discussion I first reflect
on some issues raised by Hope's analysis for modeling forecast quality in
an international context with cross-country accounting differences. A key
question is how accounting differences affect the predictability of earnings.
reporting environment and their links with analyst forecast accuracy. The
study is not based on a well-specified model of the determinants of forecast
Prior research in accounting and finance examines three main dimensions of forecast quality: accuracy, bias, and efficiency. The explanatory
variables in this model are potentially related to each quality dimension.
Predictability captures fundamental characteristics of uncertainty in the out-
comes being forecasted. Information captures the extent and quality of inputs to the forecasting model being used in prediction. Skill refers to the
forecaster's ability to design and implement a forecasting model. Finally,
Incentives reflects individual forecasters' choices over the level of effort
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
expended in forecasting.' It also reflects the potential influence that analysts' loss functions might have on the decision on the exact point forecast
to issue, given that ex ante earnings distributions might be asymmetric (Gu
and Wu [2000]).
The "dependent variable," forecast quality, is multi-dimensional. Prior an-
alyst forecast research has considered primarily forecast bias, accuracy and
efficiency, i.e. dependence of forecast errors on other information. Hope
elects to study accuracy, defined as the scaled absolute value of forecast
errors. The choice of the attribute of forecast quality to study raises important issues concerning the objective functions of the potential users of
research such as Hope's. Different research users might well be interested
in different attributes of forecasts and forecast errors. For example, regulators might be interested in the likelihood of investors experiencing large
negative shocks. Thus forecast quality cannot be defined or measured independently of characteristics of predictability, nor of the incentives of the
The relations between selected forecast quality metrics and the right-hand
side variables will potentially involve complex interactions among accounting principles, the legal and regulatory institutions surrounding accounting
standard setting, and stock markets and economic incentives. Empirical researchers, including Hope, must make compromises trading off empirical
model completeness and research cost and feasibility. I interpret Hope's
empirical tests as focusing on two potentially complementary determinants
of predictability-that is, enforcement and accounting choice-and two elements of the information environment-that is, annual report disclosure
level and analyst following. Hope includes as controls other potential correlates of predictability such as prior-year losses, the magnitude of prior-year
earnings change, and, less convincing in my view, governance-related variables from La Porta et al. [1997] such as the importance of the stock market
(mean) and accuracy (variance); and evaluation of forecast quality would still be conditional
on the research user's loss function, specifying the rate of trade-off between bias and accuracy.
3 Defining predictability itself also becomes problematic (e.g. mean v. median, standard deviation v. skewness), as does controlling for analysts' incentives (e.g. are analysts' compensated
asymmetrically based on the sign and magnitude of forecast errors?).
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
278 P. F. POPE
into his model controls for other aspects of the information environment,
such as other forms of information disclosure and differences in skill and
analysts' incentives, except to the extent that such differences are captured
by country-level or industry indicator variables. Choices to omit potentially
relevant variables, perhaps because they are difficult to measure, may be innocuous, but they could also lead to well-known inference problems. Specifically, we will not know whether a variable found to be a significant determinant of forecast quality simply acts as a proxy for another relevant variable
excluded from the analysis. My main concern with Hope's analysis is that
it gives insufficient attention to the effects of international differences in
accounting principles and how such differences are related both to forecast
accuracy and to variables included in the analysis.
2.2 EARNINGS PREDICTABILITY AND INTERNATIONAL
ACCOUNTING DIFFERENCES
accruals.4
in the level of fundamental economic uncertainty across countries.5 Crosssectional variation in the dispersion of earnings across countries is also large
(BHJ [1998, table 4]). Volatility does not necessarily imply lack of predictabil-
ables in all ordinary least squares (OLS) models and country indicator variables in one OLS specification (table 4, model 4), where they appear to
be jointly significant. This industry/country effects approach captures two
5 Estimates of stock return volatility are obtained from Quantec Quarterly, December 1992.
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
for soccer games because more points are usually scored in football than
goals are scored in soccer. We need to control for differences in the rules
if we are to make informed comparisons of the quality of punters' forecasts
Evidence that variation in accruals procedures affects earnings predictability is reported by BHJ [1998] and suggests that accounting measure-
ment differences could be important in understanding the roles of disclosure and enforcement in the accounting environment. For example, Alford
et al. [1993] report international differences in earnings timeliness. When
earnings are relatively untimely, the market will likely demand greater disclosure of information about current economic performance that will even-
tually show up in earnings. Hope does not attempt to control for variation
in accounting recognition rules in testing hypothesis 1-the cost of developing firm-level measures of recognition rules would surely be prohibitive.6
Thus, the finding that forecast accuracy is positively related to disclosure may
6 The average effects of cross-country variation in accounting measurement rules will be
captured by the country indicator variables in model 4 of table 4. But the other models in
tables 4 and 5 do not contain country-level controls.
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
280 P. F. POPE
understanding the origin of the positive relation between accuracy and enforcement in tests of hypothesis 2. However, the test of hypothesis 4 does
provide an indication that interaction between enforcement and accounting characteristics is important. The test of hypothesis 4 (table 5, model
2) reveals that forecast accuracy is negatively related to BHJ's [1998] index
of accounting choice. It is interesting that this result conflicts with BHJ's
own findings, but they do not control for enforcement. Hope also finds
that the association between enforcement and accuracy is largely due to
the interaction between enforcement and choice. Bearing in mind that the
properties and interpretation of the accounting choice index are unclear
(O'Brien [1998]), and that accounting choice is only one potentially relevant accounting dimension, it would be interesting to see future research
consider possible links between a broader set of accounting properties and
both disclosure and enforcement.
What accounting properties might be of relevance in developing a better understanding of earnings forecast accuracy? Apart from accounting
choice, BHJ [1998] suggest links between forecast accuracy and accounting
systems' use of market value accounting and of accruals. They construct
self-scored rankings of accounting systems based on these three accounting
dimensions. However, the subjectivity and ad hoc nature of the weighting of
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
disclosure being demanded when earnings are less timely. It is not simply
the level of disclosure, but the timing and content of disclosures relative
to the timing of income recognition that will determine the link between
forecast accuracy and disclosure. Thus, caution needs to be exercised in interpreting Hope's results. It might be income-recognition rules that causally
determine disclosure levels and, hence, are the more fundamental determinant of predictability and forecast accuracy.
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
282 P. F. POPE
more relevant accounting numbers to creditors through application of conservative accounting principles. Similarly, lower disclosure might emerge
in equilibrium in an economy dominated by insider equity financing and
private lending agreements because proprietary information costs will be
avoided, even though analysts' forecasts will be less accurate. Thus, it is important to be aware of the limits on what we can learn from studying a single
user group. We can learn about the determinants of the "performance" of
analysts across different environments. But we cannot judge whether one
system of financial reporting is preferable to another, except perhaps from
the perspective of the user group being studied. Future research might
attempt to examine for evidence of trade-offs between accounting system
properties across countries where the importance of analysts as information
intermediaries is lower.
4. Conclusions
The development of empirical accounting research resembles the development of scientific thought in other disciplines. Theory development tends to be at least partially inductive, relying on feedback from
empirical research. This often causes empirical research to appear incomplete in retrospect. Research such as Hope's is forced to make compromises
in the interests of analytical tractability and model parsimony. The need to
limit the scope of the analysis leaves some potentially interesting questions
unanswered and results in the need to qualify some of the inferences drawn
from the results, a point acknowledged by Hope in his conclusions. I suspect
that with hindsight our understanding of the determinants of properties of
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms
in Four East Asian Countries, And Implications For Acceptance of IAS." Working paper,
University of Rochester, 2002.
BASU, S. "The Conservatism Principle and the Asymmetric Timeliness of Earnings." Journal of
Accounting and Economics 24 (1997): 3-37.
BASU, S.; L. HUANG; AND C. JAN. "International Variation in Accounting Measurement Rules
and Analysts' Earnings Forecast Errors." Journal of Business Finance and Accounting 25 (1998):
1207-47.
COLLINS, D.; S. P. KOTHARI; J. SHANKEN; AND R. SLOAN. "Lack of Timeliness Versus Noise as
Explanations for Low Contemporaneous Return-Earnings Association."Journal ofAccounting
and Economics 18 (1994): 289-324.
DAS, S.; C. LEVINE; AND K. SIVARAMAKRISHNAN. "Earnings Predictability and Bias in Analysts'
GONEDES, N., AND N. DOPUCH. "Capital Market Equilibrium, Information Production and
Selecting Accounting Techniques." Journal of Accounting Research (Supplement 1974): 48169.
GRAY, S. "The Impact of International Accounting Differences from a Security Analysis Perspective: Some European Evidence." Journal of Accounting Research 18 (1980): 64-76.
Gu, Z., AND J. WU. "Earnings Skewness and Analyst Forecast bias." Working paper, University
of Rochester, 2000.
HELBOK, G.; AND M. WALKER. "On the Nature and Rationality of Analysts' Forecasts under
Earnings Conservatism." Working paper, University of Manchester, 2002.
HUNG, M. "Accounting Standards and Value Relevance of Financial Statements: An International Analysis." Journal of Accounting and Economics 30 (2001): 401-20.
Joos, P., AND M. LANG. "The Effects of Accounting Diversity: Evidence From The European
Union." Journal of Accounting Research 32 (Supplement 1994): 141-68.
KOTHARI, S. P. "Capital Markets Research in Accounting." Journal of Accounting and Economics
31 (2001): 105-231.
KOTHARI, S. P.; AND R. SLOAN. "Information in Prices about Future Earnings: Implications for
Earnings Response Coefficients." Journal of Accounting and Economics 15 (1992): 143-171.
LA PORTA, R.; E LOPEZ-DE-SILANES; A. SHLEIFER; AND R. VISHNY. "Legal Determinants of External
RICHARDSON, S.; S. TEOH; AND P. WYSOCKI. "Tracking Analysts' Forecasts over the Annual Earnings Horizon: Are Analysts' Forecasts Optimistic or Pessimistic?" Working paper, MIT Sloan
WATTS, R.; AND G. ZIMMERMAN. "Positive Accounting Theory: A Ten-year Prespective." Account-
This content downloaded from 152.118.24.10 on Mon, 23 May 2016 19:49:07 UTC
All use subject to http://about.jstor.org/terms