538828
JMQXXX10.1177/1077699014538828Journalism & Mass Communication QuarterlyCarr et al.
research-article2014
Article
Cynics and Skeptics:
Evaluating the Credibility
of Mainstream and Citizen
Journalism
Journalism & Mass Communication Quarterly
1–19
© 2014 AEJMC
Reprints and permissions:
sagepub.com/journalsPermissions.nav
DOI: 10.1177/1077699014538828
jmcq.sagepub.com
D. Jasun Carr1, Matthew Barnidge2, Byung Gu Lee2,
and Stephanie Jean Tsang2
Abstract
With the increase in citizen-generated news, the need to understand how individual
predispositions interact with news sources to influence perceptions of news
credibility becomes increasingly important. Using a web-based experiment, this study
examines the influences individual predispositions toward the media and politics
have on perceived credibility of mainstream and citizen journalism. Analyzing data
drawn from a representative sample of the U.S. adult population, results indicate
that media skepticism and political cynicism interact, such that cynics and skeptics
perceive citizen journalism as more credible, while non-cynics and non-skeptics think
mainstream journalism is more credible.
Keywords
media credibility, media skepticism, political cynicism, citizen journalism
With the advent of technologies such as blogs (e.g., Wordpress and Tumblr), microblogging services (e.g., Twitter and Vine), and sites devoted to user-generated video
content (e.g., YouTube and Vimeo), the ability for media users to actively participate
in the creation, dissemination, and evaluation of current events programming is now
available on a near-global scale. Many scholars have optimistically claimed that these
1Susquehanna
2University
University, Selinsgrove, PA, USA
of Wisconsin-Madison, Madison, WI, USA
Corresponding Author:
Matthew Barnidge, University of Wisconsin-Madison, 5115 Vilas Hall, 821 University Avenue, Madison,
WI 53715, USA.
Email: mbarnidge@wisc.edu
2
Journalism & Mass Communication Quarterly
developments give ordinary citizens more power in processes of information gathering and dissemination.1 Early speculation into the influence of citizen journalism on
society imbued the practice with an almost messianic ability to save both journalism
and democracy by drawing on the public to generate and police the flow of information as trust in the mainstream media declined.2 It is easy to understand these optimistic outlooks for the prospects of citizen journalism and democracy given the roots of
the citizen-driven news movements that arose “in response to a perceived crisis in the
role of the press in constituting a public sphere in which citizens could understand and
engage productively with the issues of the day.”3 Born out of a credibility crisis in the
mainstream news media system, citizen journalism itself claimed to solve what it saw
as the problems of the news. Some scholars buy into these claims, arguing that citizen
journalism provides a route for the reengagement of increasingly distrustful segments
of the public.4 Critics, on the contrary, contend that citizen journalists fail to live up to
journalistic standards and provide, at best, questionable information.5 Others promote
a more nuanced approach to the new media landscape, noting the fluid boundaries
between amateur and professional, as well as the nebulous nature of the term “citizen
journalist.”6
Regardless of the debate surrounding the relationship between citizen and professional journalists within the United States media landscape, the concerns regarding
public perception of these new voices remain strong.7 More information does not necessarily increase the quality of information. The overwhelming cacophony of voices
on the Internet, for instance, can leave the individual at a loss to distinguish the trustworthy from the dross.8 Even if citizen journalism does provide quality news, the
public may be reticent to believe that it does so,9 limiting the potentially beneficial
influences of citizen journalism on society.
Therefore, the question of information quality and perceived credibility of citizen
journalism has become critical for mass communication scholars. Before claims
regarding the democratic potential of, or accuracy of the information provided by, citizen journalism can be properly affirmed or rejected, social scientists must first address
the question of the perceived credibility of citizen journalism through systematic
research. Indeed, people will not be influenced by information if they discard or ignore
it. Therefore, if they do not find citizen journalism credible, they will exhibit few
effects from having been exposed to it. Examinations of the perceived credibility of
citizen journalism have, to this point, relied primarily on cross-sectional survey
research.10 This study fills a gap in the literature with an experimental design developed to highlight factors that influence perceptions of credibility of mainstream media
and citizen journalism.
Citizen Journalism
There are at least two general approaches to defining citizen journalism, encompassing several related concepts. Broadly, the term refers to amateur news reporting. The
concept of citizen journalism subsumes the concept of participatory journalism, which
typically refers to activities of citizens in collaboration with a mainstream media outlet
Carr et al.
3
(e.g., CNN’s “iReport”).11 Citizen journalism can also include civic or public journalism12 (i.e., journalism focused on civic affairs), as well as hyper-local journalism13
(i.e., journalism focused on particular geographic communities) if the information is
collected and presented by amateur reporters. Thus, these forms of reporting overlap
the concept of citizen journalism, but do not define it. The narrow definition of citizen
journalism focuses on the reporting of newsworthy events, usually disasters or crises
(events that the mainstream media cannot predict), typically using new media technologies, and often before the mainstream media arrive on the scene.14 The broader
definition of citizen journalism includes a range of information gathering and reporting activities, such as blogging (or microblogging) and image sharing, as well as
reporting breaking news.15 We adopt the broader perspective, defining citizen journalism as a range of amateur information reporting and sharing activities. As such, this
experiment compares the effects of a professional news report and a current affairs
video blog about the same story.
Research shows that citizen journalists include more non-public official sources
and more “popular” voices than the mainstream media,16 leading some to argue that
citizen journalism offers greater diversity in news content than mainstream news.17 On
the contrary, this trend could explain why some believe citizen journalism does not
follow professional journalistic norms and routines.18 Research has also shown that
blog users find blogs to be more credible than non-blog users19 and that trust in citizen
journalism enhances its effects on political participation.20 Although the findings may
seem intuitive, they confirm a strong relationship between the use of non-mainstream
media and the perceived credibility of non-mainstream media. Therefore, one plausible way to expand upon this line of research is to uncover the individual-level predispositions toward the media and politics that make certain individuals more inclined to
use and believe in non-mainstream news. This study examines experimentally whether
pre-existing attitudes toward journalism and politics influence perceptions of the credibility of citizen journalism.
Media Credibility
Although credibility in communication has been widely seen as partially dependent on
the source of the message, people seem to assess information from the news media
more critically than from other sources.21 Research shows that evaluations of the credibility of news media depend on factors such as perceived norms of fairness, accuracy,
and bias,22 which in turn depend at least in part on the structure of news stories.23
Similarly, the style of the host or journalist on television news shows can influence the
perceived credibility of information,24 as well as the branding of major news outlets.25
Taken together, this literature suggests that people perform a complicated mental calculus when assessing the credibility of news. They consider not only the message and
the source of the information, but also the way in which the information is presented.
Thus, perceived credibility can be broadly defined as the assessment of believability and trustworthiness of a message based on a multitude of factors involved in communication, such as message source, message content, and the medium through which
4
Journalism & Mass Communication Quarterly
the message is presented.26 Previous research indicates that perceived credibility plays
an important role in audiences’ behaviors and attitudes across domains.27 For example,
higher levels of credibility attributed to the source of a message can elicit desired
changes in health-related behaviors,28 attitudes toward social issues,29 and brand preferences.30 Of course, source credibility is not the only credibility element that impacts
the effects of a message, particularly in mediated communication environments where
the content of information and media outlets may also shape audience reactions.31
Regarding the credibility of the message itself, Fico, Richardson, and Edwards
reported that news stories that favor one side of an issue over the other tend to be rated
as biased, which in turn had a negative impact on the credibility attributed to the news
outlet publishing said stories.32 Likewise, stories deemed poorly written and uninteresting are also perceived as less credible, resulting in a decreased likelihood of eliciting desired belief changes.33 Finally, perceptions of media channels should also be
noted in the discussion of credibility. Although media skepticism—the flip side of
credibility—leads people to shun mainstream news outlets in favor of non-mainstream
ones,34 evaluations of competence, timeliness, and dynamism of news outlets influence perceptions of their credibility.35
With the proliferation of information sources, especially on the web, people may
find it difficult to establish useful heuristics for assessing the quality of information
they encounter from non-mainstream news sources. Therefore, the problem of the perceived credibility of citizen journalism is important to consider when assessing its
viability as an alternative news source. This question becomes even more pressing as
the credibility of professional news outlets deteriorates,36 and information disseminated by citizen reporters plays an increasingly important role, as seen in the coverage
of the Arab Spring and Occupy Wall Street movements.37
Therefore, in an era when people are increasingly bombarded by a mélange of professional and citizen news, it is worthwhile to investigate whether the specific source
of news influences perceptions of credibility. Broadly, individuals tend to think of
mainstream news outlets (e.g., national, local and cable television news, as well as
daily newspapers) as more credible than non-mainstream news channels (e.g., political
radio talk and political blogs).38 While these studies do not consider individual-level
predispositions toward the media and politics, they do suggest that people, in the
aggregate, think certain types of media are more credible than others. We expect to
find, therefore, that
H1: Perceived credibility of news may differ according to the mode of presentation
and source of information, such that subjects will rate (a) the professional news
program and (b) the professional journalist as more credible than the citizen news
program and journalist, respectively.
Media Skepticism
Given the above research on the effects of citizen journalism, this study aims to examine whether and how media skepticism plays a role in evaluation of citizen journalists
Carr et al.
5
and citizen journalism programs. Media skepticism can be defined as “a subjective
feeling of alienation and mistrust” toward the news media.39 How an individual sees
professional journalistic standards was found to be the basis of such limitation of
trust.40 In other words, people imagine journalists’ motivations and consider them
when making assessments about whether reporting is accurate and fair.41 Given this
tendency to consider more factors when assessing the credibility of a report, we expect
to find that skeptics will rate both news reports and journalists as less credible than
non-skeptics:
H2: Subjects high in media skepticism will rate (a) the news program and (b) the
journalist as less credible than subjects low in media skepticism.
Moreover, there might be an implicit understanding among the general public
that citizen journalists tend to be less professional and competent than mainstream
journalists.42 On the contrary, media skeptics are predisposed to be mistrustful of
mainstream journalistic standards and motivations in the first place.43 Therefore, it
is reasonable to expect that media skepticism may have different effects across types
of journalism in such a way that media skeptics may regard citizen journalism as a
credible alternative news source, whereas non-skeptics are likely to perceive mainstream media as more credible than the amateur journalism. In other words, media
skepticism may interact with news sources in shaping judgments of credibility.
Therefore, we expect that
H3: Media skepticism will interact with the news source to affect assessments of
credibility, such that media skeptics will rate (a) the citizen news program and (b)
the citizen journalist as more credible than non-skeptics will, while non-skeptics
will rate (c) the professional news program and (d) the professional journalist as
more credible than skeptics will.
Political Cynicism
In addition to media skepticism, we are also interested in the effects of political cynicism. Political cynicism results from an erosion of trust in the government and politicians,44 and has increased over time in the U.S. Whereas in 1964, 76% of Americans
believed that the U.S. government does what is right at least most of the time, only
25% believed the same in 1980.45 The downward spiral of political trust spawns political cynicism46 and alienates citizens from the political processes.47 Factors that affect
political disaffection include governmental performance,48 congressional approval,49
and congressional scandals,50 among others.
The media also play an important role in shaping perceptions about politics.51
Some have asserted that the media’s negative depiction of the government explains
the rise of cynical attitudes about politics.52 Furthermore, journalists are preoccupied
with “horse race” stories in election campaign coverage, which focus on strategy and
competition in elections53 and may contribute to political cynicism.54 By extension,
6
Journalism & Mass Communication Quarterly
political cynicism likely breeds negative perceptions of politics and the media’s coverage of politics. Therefore, we expect to find that cynics will think all news media
are less credible than non-cynics:
H4: Subjects high in political cynicism will rate (a) the news program and (b) the
journalist as less credible than subjects low in political cynicism.
However, if political cynicism is driven mainly by the mainstream media,55 it follows that cynics may come to prefer alternative journalism sources, expecting new
sorts of political reporting. Non-cynics, on the contrary, will still perceive the same
credibility problem in amateur reporting as compared to the mainstream media. We
expect, therefore, that
H5: Political cynicism will interact with the message source to affect assessments
of credibility, such that political cynics will rate (a) the citizen news program and
(b) the citizen journalist as more credible than non-cynics will, while non-cynics
will rate (c) the professional news program and (d) the professional journalist as
more credible than the cynics will.
Method
This article presents results from an experiment embedded in a web-based survey
administered to a representative sample of adults in the United States. The data were
collected over a one-week period during April 2012. Responses were obtained online
through a private company, Amazon.com’s Mechanical Turk, which offers subjects
compensation in the form of small payments or gift cards and discounts for various
consumer products. Mechanical Turk maintains an active cache of potential survey
respondents who self-select into the database and employs quota sampling techniques
using geographic and demographic parameters to create a representative sample of the
U.S. adult population. Previous research has shown that Mechanical Turk samples
deviate slightly from the national population, largely due to the self-selection of subjects into the sample pool. However, while self-selection of subjects may cause the
sample to be systematically biased in some ways, social science research has shown
that Mechanical Turk samples tend to provide estimates similar to national probability
samples.56 Furthermore, Mechanical Turk samples, while they are more biased for narrow populations, are less biased for broader populations—such as the U.S. adult population.57 Given that this research attempts to generalize to a relatively broad population
of adults in the United States, the Mechanical Turk sample therefore provides a reasonable representation of this population, and certainly provides a more representative
sample than a student sample taken from a major American university. The data contained 184 completed responses (56% female, M age = 32.36 years). Subjects were
randomly assigned to one of two conditions: the mainstream news report (n = 94) and
the citizen news report (n = 90).
Carr et al.
7
Experimental Design and Stimulus
After providing informed consent, participants completed a pre-test questionnaire and
were then directed to a prompt telling them they were about to read an e-mail “currently circulating in Colorado” sent by the fictitious political action committee (PAC)
Citizens for a Better Colorado. The e-mail attacked Sean Townsend, a fictitious
Democratic candidate for State Congress, for his inappropriate behavior and expressed
support for his opponent, Alan Baker. The e-mail also contained a link to a video of a
news story covering the scandal, which the subjects were instructed to click. Upon
clicking the link for the video, participants were randomly assigned to view one of the
two versions of a fictitious news story about a sex scandal involving Sean Townsend
and a twenty-three-year-old female intern. Following the video, subjects were directed
to a series of post-exposure questions before being debriefed and thanked for their
participation.
The news story first introduced the scandal, saying U.S. congressional candidate
Sean Townsend was facing allegations of sending inappropriate text messages to a
twenty-three-year-old female intern. The story highlights that Townsend is in a “dead
heat” with Republican Alan Baker in the race for Colorado’s fourth district congressional seat. The idea behind the inclusion of this “horse race” information is twofold.
First, the information conveys the importance of the scandal, as it could influence the
close race. Second, the information may prime subject’s political cynicism, a key element of our examination. Thus, the “horse race” information helps heighten any effects
we may observe.
The text messages in question are said to have been obtained from a source close to
the intern, who posted them on Twitter. Three texts were then displayed, all of which
were developed based on existing political scandal messages and designed to be sexually suggestive without being excessively graphic. The news host then notes that the
Townsend campaign has not commented on the issue. The segment ends by again
highlighting the close race between Townsend and Baker.
To produce the news story, a professional actor was hired to fill the role of news
host. The script was designed to mirror a typical television news format and length
(one minute forty-seven seconds). A television studio with a green screen was used to
tape the mock program, allowing the creation of stimuli that resembles local news
programming. A professional director and experienced video editor assisted in the
development and production of the scripts and stimulus materials, maintaining consistent quality and realism across the different takes and conditions.
Extreme care was taken in balancing internal and external validity while operationalizing the citizen journalism and professional journalism conditions. In both
conditions, the same actor was used to fill the role of reporter, and the information
within the story was maintained as consistently as possible, maximizing the internal
validity of the manipulations. To distinguish between citizen and professional journalism, three facets of the production were manipulated: delivery style, production
quality, and setting. Delivery style was manipulated through a combination of a more
8
Journalism & Mass Communication Quarterly
conversational tone, the citizen journalist adopted a different “voice” than the professional journalist, and through an alteration of the actor’s wardrobe, the citizen journalist wore a sweater and T-shirt whereas the professional journalist wore a suit coat,
collared shirt, and tie. Both the production quality and setting were manipulated postproduction, with the citizen journalist program containing lower quality video and
graphical elements than the professional program. The conditions were framed differently as well. The professional report used a tighter shot whereas the citizen report
captured almost the entire “room.” Finally, the green screen was used to place the
citizen journalist in a household setting, designed to look like a den or basement
room, while the professional journalist was placed in a broadcast setting, sitting at a
desk, and with graphics that conveyed network identification (the Columbia
Broadcasting System eye logo with fictional station call letters; both the e-mail and
video stimulus materials are available at www.blindreview.net/62722012c/).
Measures
Pre-test measures were created for subjects’ pre-existing levels of media skepticism
and political cynicism. Post-test measures included multiple indicators of perceived
media credibility, which give the study additional leverage over the research problem.
Accordingly, measures were created for perceived credibility of both the news program and the journalist. All questionnaire items used eleven-point scales unless otherwise noted. See Table 1 for a summary of descriptive statistics for each item.
Media skepticism. A measure of the subjects’ pre-existing levels of media trust was
constructed from the mean of five pre-experiment measures of whether the media
provide accurate and trustworthy information, whether the media deal fairly with all
sides, and whether the information provided needs to be confirmed (α = .73, M = 3.16,
SD = 0.77). We then used the median of the resulting scale as a dividing point along
which to split the subjects into two groups: skeptics, those individuals scoring below
3.2 on the computed scale (n = 96), and non-skeptics, comprised of those scoring 3.3
or higher on the scale (n = 88).
Political cynicism. Two survey items were used to establish the subjects’ pre-existing
levels of political cynicism. Respondents rated their agreement with the following
statements: “Elected officials put their own interests ahead of the public’s interest” and
“It seems like politicians only care about special interests.” These two items were
averaged (r = .41, M = 4.64, SD = 1.15). A median split of this scale was again used to
divide the subjects into two groups: those with low levels of political cynicism, those
scoring below 4 on the above scale (n = 79), and those with high levels of political
cynicism, defined as scoring 4.5 or higher on the scale (n = 105).
Program credibility. To measure how perceptions of the news program changed depending on experimental condition, respondents were asked to rate their level of agreement
with a series of program evaluations drawn from Meyer58 and Ognianova,59 including
9
Carr et al.
Table 1. Descriptive Statistics of Variables in the Analysis (N = 184).
Variable
M (π)
SD (SE)
Scale
News source (1 = Citizen Journalism)
Media skepticism
Political cynicism
Program credibility
Journalist credibility
Political ideology
(.49)
3.16
4.64
5.59
5.69
3.87
(.04)
.77
1.15
2.01
2.30
1.36
0-1
0-10
0-10
0-10
0-10
1-7
its fairness, accuracy, bias, trustworthiness, balance, and partisan nature. These six
questionnaire items were averaged to create an index (α = .84, M = 5.59, SD = 2.01).
Journalist credibility. To test how perceptions of the journalist changed depending on
experimental condition, respondents were asked to rate their level of agreement with a
series of statements about the moderator, including his credibility, fairness, reasonableness, open-mindedness, professionalism, and truth-seeking intentions.60 These six
items were averaged to create an index (α = .90, M = 5.69, SD = 2.30).
Political ideology. The models testing the influence of political cynicism also control for
the subject’s political ideology to avoid a potential confound. It could be that political
cynicism runs in a particular ideological direction dependent upon the party of the
fictitious candidate in the news report (Democrat). Subjects were asked two questions
in which they rated their own political ideology on economic issues and social issues,
respectively. The questions used seven-point scales (1 = liberal, 4 = neutral, 7 = conservative), and the responses were averaged to create the final variable (r = .68, M =
3.87, SD = 1.36).
Results
Manipulation Checks
To confirm that our experimental manipulations performed as intended, respondents
were asked to identify the source of the video. Most respondents (87%) answered the
question correctly (CBS, for those in the professional condition, and Amateur Blogger,
for those in the citizen journalism condition), and the citizen journalism group did not
provide significantly more correct answers than the professional journalism group
(3% difference; z = .37, ns). We therefore concluded that our manipulations performed
well and continued with the analysis.
News Source
Two-way analyses of variance (ANOVAs) were used to address each of the hypotheses
outlined above. H1a and H1b predict that subjects would rate the professional news
10
Journalism & Mass Communication Quarterly
Table 2. Two-way Analyses of Variance for Perceived Credibility of News Program and
Journalist by News Source, Conditional on Media Skepticism and Political Cynicism.
News source
Professional
report
Variable
Program credibility
Skeptics
Non-skeptics
Cynics
Non-cynics
Journalist credibility
Skeptics
Non-skeptics
Cynics
Non-cynics
Citizen
report
M
SD
M
SD
F
df1
df2
Pr ≥ F
5.68
5.09a
6.27a
5.14c
6.23c
5.69
4.94d
6.43d
5.04f
6.33f
.20
.28
.30
.29
.31
.23
.32
.34
.33
.35
5.53
6.25b
4.80b
5.71
5.27
5.73
6.32e
5.13e
6.06g
5.23g
.20
.28
.28
.26
.33
.23
.32
.33
.30
.37
0.30
21.57*
1
1
180
180
.584
.000
25.87*
1
179
.011
0.01
16.66*
1
1
180
180
.907
.000
9.71*
1
179
.002
*F-statistic
for the interaction between news source and the relevant comparison variable (i.e., media
skepticism or political cynicism) is reported.
a-gMean is statistically different from the mean of the relevant comparison group indicated by the same
letter. The models for political cynicism also control for political ideology, which is non-significant in both
cases.
program and journalist as more credible than the citizen news program and journalist.
We find no evidence that this is true for either program credibility, F(1, 180) = 0.30,
ns, or journalist credibility, F(1, 180) = 0.01, ns. Thus, our results show that, in the
aggregate, people generally do not consider citizen journalism to be less credible than
mainstream journalism (see Table 2 for summary of important results).
Media Skepticism
On the contrary, we do find evidence that the effects of news source on perceived credibility are conditional upon an individual’s predispositions toward the media and politics. Although there are no main effects of media skepticism on either program
credibility, F(1, 180) = 0.23, ns, or journalist credibility, F(1, 180) = 0.22, ns, leading
us to reject H2a and H2b, our results illustrate interactive effects of media skepticism
and news source on both program credibility, F(1, 180) = 21.57, p < .01, and journalist
credibility, F(1, 180) = 16.66, p < .01. These effects are transverse interactions (see
Figures 1 and 2). There are no main effects of news source, nor are there main effects
of media skepticism. The conditional effects of news source only appear when media
skepticism interacts with the news source. Pairwise comparisons show that non-skeptics think the professional report and journalist are more credible, scoring an average
of 1.18 and 1.49 higher than skeptics on the two credibility scales. Skeptics, on the
11
Carr et al.
10
9
8
M1– M2 = –1.18
(p < .01)
7
6
6.27
5.09
5
M1 – M2 = 1.45
(p < .001)
6.25
4.80
Skeptics
Non-Skeptics
4
3
2
1
0
Professional Report
Citizen Report
Figure 1. The interactive effect of news source and media skepticism on subjects’
assessments of news program credibility.
Note. 95% confidence intervals for conditional mean estimates are shown with error bars, F(1, 180) =
21.57, p < .001.
contrary, think the opposite. They rate the citizen report and journalist an average of
1.45 and 1.18 higher than non-skeptics on the credibility scales (p < .01 for all differences). These results support H3a through H3d, and suggest evaluations of media
credibility for different types of news sources are conditional on an individual’s preexisting levels of skepticism about the media.
Political Cynicism
As with media skepticism, we find evidence of transverse interactive effects of political cynicism and news source on perceived credibility. Once again, we find no main
effect of political cynicism on subjects’ evaluations of either the journalist or program credibility, F(1, 179) = 1.14, ns, F(1, 179) = 0.44, ns, respectively, leading us
to reject H4a and H4b. However, we do find a significant interactive effect between
political cynicism and news source in the evaluation of credibility for both journalist
credibility, F(1, 179) = 6.61, p < .05, and program credibility, F(1, 179) = 9.71, p <
.01. This effect exists even while controlling for the influence of the subjects’ political ideology, F(1, 179) = 0.44, ns, for program credibility; F(1, 179) = 0.42, ns, for
journalist credibility. As with media skepticism, pairwise comparisons reveal a
transverse interactive effect (see Figures 3 and 4). Non-cynics rate the credibility of
the professional report and journalist an average of 1.08 and 1.29 higher than cynics
(p < .05). Cynics, on the contrary, think the citizen report and journalist were more
credible, rating them an average of .45 (ns) and .83 (p < .05) higher on the credibility
scales than non-cynics. These findings support H5a through H5d and show that
political cynics are likely to find citizen journalism more credible than the
12
Journalism & Mass Communication Quarterly
10
M1 – M2 = –1.49
(p < .01)
9
8
6.43
7
6
M1 – M2 = 1.18
(p < .01)
6.32
5.13
4.94
5
Skeptics
4
Non-Skeptics
3
2
1
0
Professional Journalist
Citizen Journalist
Figure 2. The interactive effect of news source and media skepticism on subjects’
assessments of the journalist’s credibility.
Note. 95% confidence intervals for mean estimates are shown with error bars, F(1, 180) = 16.66, p = .011.
10
9
M1 – M2 = –1.08
(p < .05)
M1 – M2 = 0.45
(ns)
8
7
6
6.23
5.14
5.71
5.27
Cynics
Non-Cynics
5
4
3
2
1
0
Professional Report
Citizen Report
Figure 3. The interactive effect of news source and political cynicism on subjects’
assessments of news program credibility.
Note. 95% confidence intervals for mean estimates are shown with error bars, F(1, 179) = 25.87, p < .001.
mainstream media, whereas those who have confidence in the political system tend
to think the opposite.
Discussion
Taken together, our results demonstrate that the effects of different news sources on
the perceived credibility of information are conditional upon pre-existing attitudes
13
Carr et al.
10
9
8
M1 – M2 = –1.29
(p < .01)
7
6
6.33
5.04
M1 – M2 = 0.83
(p < .05)
6.06
5.23
5
Cynics
4
Non-Cynics
3
2
1
0
Professional Journalist
Citizen Journalist
Figure 4. The interactive effect of news source and political cynicism on subjects’
assessments of the journalist’s credibility.
Note. 95% confidence intervals for mean estimates are shown with error bars, F(1, 179) = 9.71, p = .002.
toward the news media and politics. While, on the aggregate, people do not differentiate between the credibility of mainstream and citizen journalism, these assessments
are dependent upon an individual’s levels of media skepticism and political cynicism.
In our sample, cynics and skeptics found citizen journalism more credible than mainstream journalism, while non-cynics and non-skeptics expressed the opposite.
The conditionality of the effects we observe is certainly the most important aspect
of our findings. Although we expected such conditionality, we also expected to observe
a main effect of the news source. However, without considering their attitudes toward
the media and political predispositions, subjects in our sample do not distinguish
between the two sources of news. This finding implies that in an era of proliferating
sources of news and information, especially on the Internet, people may distinguish
less and less between mainstream and alternative sources of news and information, at
least on the aggregate level. This conclusion must be qualified, of course, by the consideration that our citizen journalist manipulation remained relatively close to traditional news presentation formats to maintain the internal validity of the experiment.
Perhaps if the citizen journalist condition had been even more informal in style and
tone, a main effect of the news source would have manifested. Still, holding the specific information presented in the news story constant, subjects do not necessarily
distinguish between the professional and citizen report. From one perspective, these
findings would appear to conflict with previous research showing differences between
types of news media and between mainstream and alternative news media.61 On the
contrary, those studies focused on differences between media themselves (e.g., newspapers vs. television and online news),62 whereas our study compared a professional
and amateur report viewed on the same medium. Furthermore, any discrepancies that
14
Journalism & Mass Communication Quarterly
appear to exist with previous research disappear once we consider individual-level
predispositions toward the media and politics. It turns out that people do distinguish
between media types. However, these distinctions are conditional upon pre-existing
levels of media skepticism and political cynicism.
Our results fit nicely with a body of literature suggesting that media skeptics are
less likely to trust the mainstream news media because they are suspicious of common
journalistic practices.63 Our findings extend this body of literature by demonstrating
the conditionality of media skepticism’s influence. It is not simply that media skeptics
are more critical of all media; rather, they are more critical of mainstream news than
they are of alternative news outlets. This conclusion implies that media skeptics may
find refuge in citizen journalism, seeking out alternative sources of information in
reply to their critical stance toward the mainstream news media. Certainly, this conclusion will perhaps help to abate fears about the declining trust in the mainstream news
media.64 Once again, however, this conclusion must be qualified. If the quality of
information presented in citizen journalism is, in reality, not comparable to the quality
of information in professional journalism, media skeptics may receive inaccurate,
incomplete, misleading, or slanted information from their preferred news sources.
This possibility, of course, hardly seems positive for the prospects of an informed
citizenry.
Our findings also show the conditional influence of political cynicism. Knowing
that political scandals prime political cynicism,65 it is not surprising to see its effects
on perceived credibility. What is new and important about our findings is, once
again, the conditionality of the effects. Many studies have explored the link between
mainstream news media coverage of politics and the development of political cynicism.66 However, fewer studies have compared mainstream news to alternative news
sources. The addition this study makes to the literature is the suggestion that political cynics, like media skeptics, are more critical of the mainstream news media than
they are of citizen journalism. This could be because they view citizen journalists as
political outsiders, not constrained by the same need to maintain contacts in political
circles. Again, these results generally point toward an optimistic conclusion for an
informed citizenry, assuming citizen journalism provides its audience with quality
information.
Previous research has focused on how news media lead to the development of dispositions such as media skepticism67 and political cynicism.68 Our study addresses the
reflexive nature of this relationship, exploring how political cynicism and media skepticism influence perceptions of the media. Our evidence therefore implies the possibility of a reciprocal relationship between individual predispositions and media
exposure.69 However, our evidence also shows that political cynics and media skeptics
find solace from the mainstream media in citizen journalism. This idea provides a
more hopeful outlook than the “spiral of cynicism” argument supposes.70 Indeed, cynics may become more trusting over time if they pay attention to news sources they
believe. On the contrary, if citizen journalism provides the same type of information as
mainstream journalism, its audience may grow even more cynical over time.
Carr et al.
15
The findings of this study are tempered by several important limitations. First,
while every effort was made to maintain the ecological validity of the stimulus materials, the news story and candidate were, in fact, not real. This problem could be particularly acute among subjects who reside in Colorado, as they may have realized the
stimulus was not real. Furthermore, the stimulus may not be representative of all forms
of citizen journalism on the web. In fact, the stimulus for both conditions used the
same information, and thus represents a relatively more formal style of citizen reporting. Next, the results of the study may not be generalizable beyond the context of
political scandal. Different informational contexts could produce different reactions
among cynics and skeptics. Furthermore, while we have previously argued that the
Mechanical Turk sample is representative of the U.S. adult population, some consideration must be given to the possibility that the results of this study are specific to the
sample under examination, even while this possibility seems relatively unlikely.
Additional concerns remain regarding the Mechanical Turk sample, specifically the
use of paid subjects. However, the practice of compensating study respondents is common in the communications field, particularly in experimental research. Given the
representative nature of the sample obtained and the existing research supporting this
approach,71 the researchers are confident that any effects stemming from the sample
recruitment techniques are minimal. Another important consideration is that subjects
potentially engaged with the video materials under different conditions, which could
create an experimental confound. However, within real-world settings, citizens regularly engage with the news media through a variety of formats, and the lack of control
over the viewing environment provides a more naturalistic context for exposure. In
addition, given the randomization procedure, any effect caused by differing viewing
environments should be distributed evenly between the two conditions. The final limiting consideration is that the stimulus was designed and the experiment was administered with the U.S. context in mind, and therefore these results may not generalize to
non-U.S. contexts.
Despite these limitations, this experiment has provided strong evidence that cynics
and skeptics believe citizen journalism is more credible than mainstream journalism,
and that non-cynics and non-skeptics believe the opposite. Some scholars have claimed
that the proliferation of citizen journalism could help disaffected and distrustful citizens re-engage with the news media and with politics.72 Our study supports this optimistic outlook, showing that cynics and skeptics view citizen journalists as more
credible than the mainstream media. In all, the idea that citizens who distrust the mainstream news media have placed their trust in alternative sources of news and information leads to renewed hopefulness about having an informed and engaged electorate in
the United States, contingent on the quality of information citizen journalism provides,
and underscores the importance of alternative news outlets in American society.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship,
and/or publication of this article.
16
Journalism & Mass Communication Quarterly
Funding
The author(s) received no financial support for the research, authorship, and/or publication of
this article.
Notes
1. Stuart Allan, “Histories of Citizen Journalism,” in Citizen Journalism: Global
Perspectives, ed. Stuart Allen and Einar Thorsen (NY: Peter Lang, 2009), 17-32; Shayne
Bowman and Chris Willis, “We Media: How Audiences Are Shaping the Future of News
and Information,” Report for the Media Center and the American Press Institute, July
2003, http://www.hypergene.net/wemedia/download/we_media.pdf (accessed February
24, 2014); Mark Deuze, “The Web and Its Journalisms: Considering the Consequences of
Different Types of News Media Online,” New Media & Society 5 (June 2003): 203-30.
2. Stephen D. Cooper, Watching the Watchdog: Bloggers as the Fifth Estate (Spokane, WA:
Marquette Books, 2006); James Curran and Jean Seaton, Power without Responsibility:
The Press and Broadcasting in Britain (London: Routledge, 1997).
3. Sandra L. Nichols, Lewis A. Friedland, Hernando Rojas, Jaeho Cho, and Dhavan V.
Shah, “Examining the Effects of Public Journalism on Civil Society from 1994 to 2002:
Organizational Factors, Project Features, Story Frames, and Citizen Engagement,”
Journalism & Mass Communication Quarterly 83 (spring 2006): 77-100.
4. Michael Schudson, The Good Citizen: A History of American Civic Life (NY: Martin
Kessler Books, 1999).
5. Jane B. Singer and Ian Ashman, “User-Generated Content and Journalistic Values,” in
Citizen Journalism: Global Perspectives, ed. Stuart Allan and Esther Thorson (NY: Peter
Lang, 2009), 233-34.
6. Luke Goode, “Social News, Citizen Journalism and Democracy,” New Media & Society
11 (December 2009): 1287-305; Joseph D. Lasica, “What Iis Participatory Journalism?”
Online Journalism Review, August 7, 2003, http://www.ojr.org/ojr/workplace/1060217106.
php (accessed February 24, 2014).
7. Axel Bruns, “Gatewatching, Not Gatekeeping: Collaborative Online News,” Media
International Australia, Incorporating Culture & Policy 107 (May 2003): 31-44.
8. Cass R. Sunstein, Republic.com 2.0: Revenge of the Blogs (Princeton, NJ: Princeton
University Press, 2007).
9. Seth C. Lewis, Kelly Kaufhold, and Dominic L. Lasorsa, “Thinking about Citizen
Journalism: The Philosophical and Practical Challenges of User-Generated Content for
Community Newspapers,” Journalism Practice 4 (summer 2010): 163-79.
10. Thomas J. Johnson and Barbara K. Kaye, “Wag the Blog: How Reliance on Traditional
Media and the Internet Influence Credibility Perceptions of Weblogs among Blog Users,”
Journalism & Mass Communication Quarterly 81 (autumn 2004): 622-42; Kelly Kaufhold,
Sebastian Valenzuela, and Homero Gil de Zúñiga, “Citizen Journalism and Democracy:
How User-Generated News Use Relates to Political Knowledge and Participation,”
Journalism & Mass Communication Quarterly 87 (autumn 2010): 515-29.
11. Bowman and Willis, “We Media.”
12. Lewis Friedland and Sandra L. Nichols, “Measuring Civic Journalism’s Progress: A Report
across a Decade of Activity,” Report for the Pew Center for Civic Journalism, September
2002, http://www.pewcenter.org/doingcj/research/measuringcj.pdf (accessed February 24,
2014); Lewis Friedland, Mira Sotirovic, and Katie Daily, “Public Journalism and Social
Capital: The Case of Madison, Wisconsin,” in Assessing Public Journalism, ed. Edmund
Carr et al.
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
26.
27.
28.
29.
17
B. Lambeth, Philip E. Meyer, and Esther Thorson (Columbia: University of Missouri
Press, 1998), 191-220.
Emily T. Metzgar, David D. Kurpius, and Karen M. Rowley, “Defining Hyperlocal Media:
Proposing a Framework for Discussion,” New Media & Society 13 (August 2011): 772-87.
Allan, “Histories of Citizen Journalism.”
Goode, “Social News, Citizen Journalism and Democracy.”
Serena Carpenter, “How Online Citizen Journalism Publications and Online Newspapers
Utilize the Objectivity Standard and Rely on External Sources,” Journalism & Mass
Communication Quarterly 85 (autumn 2008): 531-48.
Serena Carpenter, “A Study of Content Diversity in Online Citizen Journalism and Online
Newspaper Articles,” New Media & Society 12 (November 2010): 1064-84.
Singer and Ashman, “User-Generated Content.”
Johnson and Kaye, “Wag the Blog.”
Kaufhold, Valenzuela, and Gil de Zúñiga, “Citizen Journalism and Democracy.”
Spiro Kiousis, “Public Trust or Mistrust? Perceptions of Media Credibility in the
Information Age,” Mass Communication and Society 4 (winter 2001): 381-403.
Frederick Fico, John D. Richardson, and Steven M. Edwards, “Influence of Story Structure
on Perceived Story Bias and News Organization Credibility,” Mass Communication and
Society 7 (autumn 2004): 301-18.
Fico, Richardson, and Edwards, “Influence of Story Structure”; Cheryl Campanella
Bracken, “Perceived Source Credibility of Local Television News: The Impact of
Television Form and Presence,” Journal of Broadcasting & Electronic Media 50 (winter
2006): 723-41.
Emily K. Vraga, Stephanie Edgerly, Leticia Bode, D. Jasun Carr, Mitchell Bard, Courtney
N. Johnson, Young Mie Kim, and Dhavan V. Shah, “The Correspondent, the Comic, and
the Combatant: The Consequences of Host Style in Political Talk Shows,” Journalism &
Mass Communication Quarterly 89 (spring 2012): 5-22.
Sylvia M. Chan-Olmsted and Jiyoung Cha, “Exploring the Antecedents and Effects of
Brand Images for Television News: An Application of Brand Personality Construct in
a Multichannel News Environment,” International Journal on Media Management 10
(spring 2008): 32-45; Jooyoung Kim, Tae Hyun Baek, and Hugh J. Martin, “Dimensions of
News Media Brand Personality” Journalism & Mass Communication Quarterly 87 (spring
2010): 117-34.
Carl I. Hovland, Irving L. Janis, and Harold H. Kelley, Communication and Persuasion:
Psychological Studies of Opinion Change (New Haven, CT: Yale University Press, 1953);
Kiousis, “Public Trust or Mistrust?”; Daniel J. O’Keefe, Persuasion: Theory and Research
(Newbury Park, CA: SAGE, 1990).
Hovland, Janis, and Kelley, Communication and Persuasion; Richard E. Petty and John T.
Cacioppo, “The Elaboration Likelihood Model of Persuasion,” Advances in Experimental
Social Psychology 19 (1986): 123-205; Chanthika Pornpitakpan, “The Persuasiveness of
Source Credibility: A Critical Review of Five Decades’ Evidence,” Journal of Applied
Social Psychology 34 (February 2004): 243-81; Brian Sternthal, Ruby Dholakia, and
Clark Leavitt, “The Persuasive Effect of Source Credibility: Tests of Cognitive Response,”
Journal of Consumer Research 4 (March 1978): 252-60.
Pornpitakpan, “The Persuasiveness of Source Credibility.”
Herbert C. Kelman and Carl I. Hovland, “‘Reinstatement’ of the Communicator in Delayed
Measurement of Opinion Change,” Journal of Abnormal Psychology 48 (July 1953):
327-35.
18
Journalism & Mass Communication Quarterly
30. Ronald E. Goldsmith, Barbara A. Lafferty, and Stephen J. Newell, “The Impact of
Corporate Credibility and Celebrity Credibility on Consumer Reaction to Advertisements
and Brands,” Journal of Advertising 29 (autumn 2000): 43-54.
31. Kiousis, “Public Trust or Mistrust?”
32. Fico, Richardson, and Edwards, “The Influence of Story Structure.”
33. Michael D. Slater and Donna Rouner, “How Message Evaluation and Source Attributes May
Influence Credibility Assessment and Belief Change,” Journalism & Mass Communication
Quarterly 73 (winter 1996): 974-91.
34. Yariv Tsfati and Joseph N. Cappella, “Do People Watch What They Do Not Trust? Exploring
the Association between News Media Skepticism and Exposure,” Communication Research
30 (October 2003): 504-29.
35. Chan-Olmsted and Cha, “Exploring the Antecedents and Effects of Brand Images for
Television News.”
36. Joseph N. Cappella and Kathleen Hall Jamieson, Spiral of Cynicism: The Press and the
Public Good (NY: Oxford University Press, 1997); Tsfati and Cappella, “Do People Watch
What They Do Not Trust?”
37. Neal Caren and Sarah Gaby, “Occupy Online: How Cute Old Men and Malcolm X
Recruited 400,000 US Users to OWS on Facebook,” Social Movement Studies: Journal of
Social, Cultural, and Political Protest 11 (autumn-winter 2011); Habibul Haque Khondker,
“Role of the New Media in the Arab Spring,” Globalizations 8 (October 2011): 675-79.
38. Tsfati and Cappella, “Do People Watch What They Do Not Trust?”
39. Yariv Tsfati, “Media Skepticism and Climate of Opinion Perception,” International
Journal of Public Opinion Research 15 (spring 2003): 65-82.
40. Tamar Liebes, “‘Look Me Straight in the Eye’: The Political Discourse of Authenticity,
Spontaneity, and Sincerity,” The Communication Review 4 (winter 2001): 499-510.
41. Cappella and Jamieson, Spiral of Cynicism.
42. Kirsten A. Johnson and Susan Wiedenbeck, “Enhancing Perceived Credibility of Citizen
Journalism Websites,” Journalism & Mass Communication Quarterly 86 (summer 2009):
332-48.
43. Tsfati, “Media Skepticism and Climate of Opinion Perception”; Liebes, “Look Me Straight
in the Eye”; Cappella and Jamieson, Spiral of Cynicism.
44. Robert E. Agger, Marshall N. Goldstein, and Stanley A. Pearl, “Political Cynicism:
Measurement and Meaning,” The Journal of Politics 23 (August 1961): 477-506.
45. Marc J. Hetherington and Thomas J. Rudolph, “Priming, Performance, and the Dynamics
of Political Trust,” The Journal of Politics 70 (April 2008): 498-512.
46. Cappella and Jamieson, Spiral of Cynicism.
47. Bruce E. Pinkleton and Eric Weintraub Austin, “Media Perception and Public Affairs
Apathy in the Politically Inexperienced,” Mass Communication and Society 7 (autumn
2004): 319-37.
48. Jack Citrin and Donald P. Green, “Presidential Leadership and the Resurgence of Trust
in Government,” British Journal of Political Science 16 (October 1986): 431-53; John
T. Williams, “Systemic Influences on Political Trust: The Importance of Perceived
Institutional Performance,” Political Methodology 11 (spring-summer 1985): 125-42.
49. Stanley Feldman, “The Measure and Meaning of Trust in Government,” Political
Methodology 9 (autumn 1983): 341-54.
50. Virginia A. Chanley, Thomas J. Rudolph, and Wendy M. Rahn, “The Origins and
Consequences of Public Trust in Government: A Time Series Analysis,” Public Opinion
Quarterly 64 (autumn 2000): 239-56; Jane Mansbridge, “Social and Cultural Causes of
Carr et al.
51.
52.
53.
54.
55.
56.
57.
58.
59.
60.
61.
62.
63.
64.
65.
66.
67.
68.
69.
70.
71.
72.
19
Dissatisfaction with U.S. Government,” in Why Americans Don’t Trust Government, ed.
Joseph S. Nye Jr., Phillip D. Zelikow, and David C. King (Cambridge, MA: Harvard
University Press, 1997), 133-54.
Walter Lippmann, Public Opinion (NY: Macmillan Company, 1922).
Seymour Martin Lipset and William Schneider, “The Decline of Confidence in American
Institutions,” Political Science Quarterly 98 (autumn 1983): 379-402.
Kathleen Hall Jamieson, Dirty Politics: Deception, Distraction, and Democracy (NY:
Oxford University Press, 1992); Cappella and Jamieson, Spiral of Cynicism.
Cappella and Jamieson, Spiral of Cynicism.
Cappella and Jamieson, Spiral of Cynicism.
Adam J. Berinsky, Gregory A. Huber, and Gabriel S. Lenz, “Evaluating Online Labor
Markets for Experimental Research: Amazon.com’s Mechanical Turk,” Political Analysis
20 (summer 2012): 351-68.
Berinsky, Huber, and Lenz, “Evaluating Online Labor Markets.”
Philip Meyer, “Defining and Measuring Credibility of Newspapers: Developing an Index,”
Journalism & Mass Communication Quarterly 65 (autumn 1988): 567-74.
Ekaterina Ognianova, “Effects of the Content Provider’s Perceived Credibility and Identity
on Ad Processing in Computer-Mediated Environments” (paper presented at the American
Academy of Advertising Annual Conference, Lexington, Kentucky, March 1998).
Petty and Cacioppo, “The Elaboration Likelihood Model”; James C. McCroskey and
Jason J. Teven, “Goodwill: An Examination of the Construct and Its Measurement,”
Communication Monographs 66 (winter 1999): 90-103; Cecilie Gaziano and Kristin
McGrath, “Measuring the Concept of Credibility,” Journalism Quarterly 63 (autumn
1986): 451-62.
Kiousis, “Public Trust or Mistrust?”; Flanagin and Metzger, “Perceptions of Internet
Information Credibility”; Tsfati and Cappella, “Do People Watch What They Do Not
Trust?”
Kiousis, “Public Trust or Mistrust?”; Flanagin and Metzger, “Perceptions of Internet
Information Credibility”; Tsfati and Cappella, “Do People Watch What They Do Not
Trust?”
Tsfati, “Media Skepticism and Climate of Opinion Perception”; Liebes, “Look Me Straight
in the Eye”; Cappella and Jamieson, Spiral of Cynicism.
Cappella and Jamieson, Spiral of Cynicism; Tsfati and Cappella, “Do People Watch What
They Do Not Trust?”
Chanley, Rudolph, and Rahn, “The Origins and Consequences of Public Trust”; Mansbridge,
“Social and Cultural Causes of Dissatisfaction.”
Cappella and Jamieson, Spiral of Cynicism; Lipset and Schneider, “The Decline of
Confidence”; William J. Crotty and Gary C. Jacobson, American Parties in Decline
(Boston, MA: Little, Brown, 1980).
Tsfati, “Media Skepticism and Climate of Opinion Perception.”
Cappella and Jamieson, Spiral of Cynicism; Lipset and Schneider, “The Decline of
Confidence”; Crotty and Jacobson, American Parties in Decline.
Cappella and Jamieson, Spiral of Cynicism.
Cappella and Jamieson, Spiral of Cynicism.
Earl R. Babbie, The Practice of Social Research (Belmont, CA: Cengage Learning, 2013).
Allan, “Histories of Citizen Journalism”; Bowman and Willis, “We Media”; Deuze, “The
Web and Its Journalisms”; Nichols et al., “Examining the Effects of Public Journalism”;
Schudson, The Good Citizen.