Chapter 1 Science and Scientific Research
Chapter 1 Science and Scientific Research
Chapter 1 Science and Scientific Research
What is research? Depending on who you ask, you will likely get very different
answers to this seemingly innocuous question. Some people will say that they
routinely research different online websites to find the best place to buy goods or
services they want. Television news channels supposedly conduct research in the
form of viewer polls on topics of public interest such as forthcoming elections or
government-funded projects. Undergraduate students research the Internet to find
the information they need to complete assigned projects or term papers. Graduate
students working on research projects for a professor may see research as collecting
or analyzing data related to their project. Businesses and consultants research
different potential solutions to remedy organizational problems such as a supply
chain bottleneck or to identify customer purchase patterns. However, none of the
above can be considered “scientific research” unless: (1) it contributes to a body of
science, and (2) it follows the scientific method. This chapter will examine what these
terms mean.
Science
The natural sciences are different from the social sciences in several respects. The
natural sciences are very precise, accurate, deterministic, and independent of the
person m aking the scientific observations. For instance, a scientific experiment in
physics, such as measuring the speed of sound through a certain media or the
refractive index of water, should always yield the exact same results, irrespective of
the time or place of the experiment, or the person conducting the experiment. If two
students conducting the same physics experiment obtain two different values of
these physical properties, then it generally means that one or both of those students
must be in error. However, the same cannot be said for the social sciences, which
tend to be less accurate, deterministic, or unambiguous. For instance, if you
measure a person’s happiness using a hypothetical instrument, you may find that the
same person is more happy or less happy (or sad) on different days and sometimes,
at different times on the same day. One’s happiness may vary depending on the
news that person received that day or on the events that transpired earlier during
that day. Furthermore, there is not a single instrument or metric that can accurately
measure a person’s happiness. Hence, one instrument may calibrate a person as
being “more happy” while a second instrument may find that the same person is
“less happy” at the same instant in time. In other words, there is a high degree of
measurement error in the social sciences and there is considerable uncertainty and
little agreement on social science policy decisions. For instance, you will not find
many disagreements among natural scientists on the speed of light or the speed of
the earth around the sun, but you will find numerous disagreements among social
scientists on how to solve a social problem such as reduce global terrorism or rescue
an economy from a recession. Any student studying the social sciences must be
cognizant of and comfortable with handling higher levels of ambiguity, uncertainty,
and error that come with such sciences, which merely reflects the high variability of
social objects.
Sciences can also be classified based on their purpose. Basic sciences , also called
pure sciences, are those that explain the most basic objects and forces, relationships
between them, and laws governing them. Examples include physics, mathematics,
and biology. Applied sciences , also called practical sciences, are sciences that
apply scientific knowledge from basic sciences in a physical environment. For
instance, engineering is an applied science that applies the laws of physics and
chemistry for practical applications such as building stronger bridges or fuel efficient
combustion engines, while medicine is an applied science that applies the laws of
biology for solving human ailments. Both basic and applied sciences are required for
human development. However, applied sciences cannot stand on their own right, but
instead relies on basic sciences for its progress. Of course, the industry and private
enterprises tend to focus more on applied sciences given their practical value, while
universities study both basic and applied sciences.
Scientific Knowledge
The goal of scientific research is to discover laws and postulate theories that can
explain natural or social phenomena, or in other words, build scientific knowledge. It
is important to understand that this knowledge may be imperfect or even quite far
from the truth. Sometimes, there may not be a single universal truth, but rather an
equilibrium of “multiple truths.” We must understand that the theories, upon which
scientific knowledge is based, are only explanations of a particular phenomenon, as
suggested by a scientist. As such, there may be good or poor explanations,
depending on the extent to which those explanations fit well with reality, and
consequently, there may be good or poor theories. The progress of science is
marked by our progression over time from poorer theories to better theories, through
better observations using more accurate instruments and more informed logical
reasoning.
Scientific Research
Given that theories and observations are the two pillars of science, scientific
research operates at two levels: a theoretical level and an empirical level. The
theoretical level is concerned with developing abstract concepts about a natural or
social phenomenon and relationships between those concepts (i.e., build “theories”),
while the empirical level is concerned with testing the theoretical concepts and
relationships to see how well they reflect our observations of reality, with the goal of
ultimately building better theories. Over time, a theory becomes more and more
refined (i.e., fits the observed reality better), and the science gains maturity.
Scientific research involves continually moving back and forth between theory and
observations. Both theory and observations are essential components of scientific
research. For instance, relying solely on observations for making inferences and
ignoring theory is not considered valid scientific research.
Depending on a researcher’s training and interest, scientific inquiry may take one of
two possible forms: inductive or deductive. In inductive research , the goal of a
researcher is to infer theoretical concepts and patterns from observed data. In
deductive research , the goal of the researcher is to test concepts and patterns
known from theory using new empirical data. Hence, inductive research is also
called theory-building research, and deductive research is theory-testing research.
Note here that the goal of theory-testing is not just to test a theory, but possibly to
refine, improve, and extend it. Figure 1.1 depicts the complementary nature of
inductive and deductive research. Note that inductive and deductive research are
two halves of the research cycle that constantly iterates between theory and
observations. You cannot do inductive or deductive research if you are not familiar
with both the theory and data components of research. Naturally, a complete
researcher is one who can traverse the entire research cycle and can handle both
inductive and deductive research.
Theory building and theory testing are particularly difficult in the social sciences,
given the imprecise nature of the theoretical concepts, inadequate tools to measure
them, and the presence of many unaccounted factors that can also influence the
phenomenon of interest. It is also very difficult to refute theories that do not work. For
instance, Karl Marx’s theory of communism as an effective means of economic
production withstood for decades, before it was finally discredited as being inferior to
capitalism in promoting economic growth and social welfare. Erstwhile communist
economies like the Soviet Union and China eventually moved toward more
capitalistic economies characterized by profit-maximizing private enterprises.
However, the recent collapse of the mortgage and financial industries in the United
States demonstrates that capitalism also has its flaws and is not as effective in
fostering economic growth and social welfare as previously presumed. Unlike
theories in the natural sciences, social science theories are rarely perfect, which
provides numerous opportunities for researchers to improve those theories or build
their own alternative theories.
Conducting scientific research, therefore, requires two sets of skills – theoretical and
methodological – needed to operate in the theoretical and empirical levels
respectively. Methodological skills (“know-how”) are relatively standard, invariant
across disciplines, and easily acquired through doctoral programs. However,
theoretical skills (“know-what”) is considerably harder to master, requires years of
observation and reflection, and are tacit skills that cannot be “taught” but rather
learned though experience. All of the greatest scientists in the history of mankind,
such as Galileo, Newton, Einstein, Neils Bohr, Adam Smith, Charles Darwin, and
Herbert Simon, were master theoreticians, and they are remembered for the theories
they postulated that transformed the course of science. Methodological skills are
needed to be an ordinary researcher, but theoretical skills are needed to be an
extraordinary researcher!
Scientific Method
“theory”, even though psychoanalysis may have practical utility in treating certain
types of ailments.
Before closing this chapter, it may be interesting to go back in history and see how
science has evolved over time and identify the key scientific minds in this evolution.
Although instances of scientific progress have been documented over many
centuries, the terms “science,” “scientists,” and the “scientific method” were coined
only in the 19 th century. Prior to this time, science was viewed as a part of
philosophy, and coexisted with other branches of philosophy such as logic,
metaphysics, ethics, and aesthetics, although the boundaries between some of
these branches were blurred.
In the earliest days of human inquiry, knowledge was usually recognized in terms of
theological precepts based on faith. This was challenged by Greek philosophers
such as Plato, Aristotle, and Socrates during the 3 rd century BC, who suggested
that the fundamental nature of being and the world can be understood more
accurately through a process of systematic logical reasoning called rationalism . In
particular, Aristotle’s classic work Metaphysics (literally meaning “beyond physical
[existence]”) separated theology (the study of Gods) from ontology (the study of
being and existence) and universal science (the study of first principles, upon which
logic is based). Rationalism (not to be confused with “rationality”) views reason as
the source of knowledge or justification, and suggests that the criterion of truth is not
sensory but rather intellectual and deductive, often derived from a set of first
principles or axioms (such as Aristotle’s “law of non-contradiction”).
The next major shift in scientific thought occurred during the 16 th century, when
British philosopher Francis Bacon (1561-1626) suggested that knowledge can only
be derived from observations in the real world. Based on this premise, Bacon
emphasized knowledge acquisition as an empirical activity (rather than as a
reasoning activity), and developed empiricism as an influential branch of philosophy.
Bacon’s works led to the popularization of inductive methods of scientific inquiry, the
development of the “scientific method” (originally called the “Baconian method”),
consisting of systematic observation, measurement, and experimentation, and may
have even sowed the seeds of atheism or the rejection of theological precepts as
“unobservable.”
At about the same time, French philosopher Auguste Comte (1798–1857), founder of
the discipline of sociology, attempted to blend rationalism and empiricism in a new
doctrine called positivism . He suggested that theory and observations have circular
dependence on each other. While theories may be created via reasoning, they are
only authentic if they can be verified through observations. The emphasis on
verification started the separation of modern science from philosophy and
metaphysics and further development of the “scientific method” as the primary
means of validating scientific claims. Comte’s ideas were expanded by Emile
Durkheim in his development of sociological positivism (positivism as a foundation
for social research) and Ludwig Wittgenstein in logical positivism.
Likewise, antipositivists have also been criticized for trying only to understand
society but not critiquing and changing society for the better. The roots of this
thought lie in Das Capital , written by German philosophers Karl Marx and Friedrich
Engels, which critiqued capitalistic societies as being social inequitable and
inefficient, and recommended resolving this inequity through class conflict and
proletarian revolutions. Marxism inspired social revolutions in countries such as
Germany, Italy, Russia, and China, but generally failed to accomplish the social
equality that it aspired. Critical research (also called critical theory) propounded by
Max Horkheimer and Jurgen Habermas in the 20 th century, retains similar ideas of
critiquing and resolving social inequality, and adds that people can and should
consciously act to change their social and economic circumstances, although their
ability to do so is constrained by various forms of social, cultural and political
domination. Critical research attempts to uncover and critique the restrictive and
alienating conditions of the status quo by analyzing the oppositions, conflicts and
contradictions in contemporary society, and seeks to eliminate the causes of
alienation and domination (i.e., emancipate the oppressed class). More on these
different research philosophies and approaches will be covered in future chapters of
this book.
This requires visualizing the abstract from actual observations, mentally “connecting
the dots” to identify hidden concepts and patterns, and synthesizing those patterns
into generalizable laws and theories that apply to other contexts beyond the domain
of the initial observations. Research involves constantly moving back and forth from
an empirical plane where observations are conducted to a theoretical plane where
these observations are abstracted into generalizable laws and theories. This is a skill
that takes many years to develop, is not something that is taught in graduate or
doctoral programs or acquired in industry training, and is by far the biggest deficit
amongst Ph.D. students. Some of the mental abstractions needed to think like a
researcher include unit of analysis, constructs, hypotheses, operationalization,
theories, models, induction, deduction, and so forth, which we will examine in this
chapter.
Unit of Analysis
One of the first decisions in any social science research is the unit of analysis of a
scientific study. The unit of analysis refers to the person, collective, or object that is
the target of the investigation. Typical unit of analysis include individuals, groups,
organizations, countries, technologies, objects, and such. For instance, if we are
interested in studying people’s shopping behavior, their learning outcomes, or their
attitudes to new technologies, then the unit of analysis is the individual . If we want to
study characteristics of street gangs or teamwork in organizations, then the unit of
analysis is the group . If the goal of research is to understand how firms can improve
profitability or make good executive decisions, then the unit of analysis is the firm . In
this case, even though decisions are made by individuals in these firms, these
individuals are presumed to represent their firm’s decision rather than their personal
decisions. If research is directed at understanding differences in national cultures,
then the unit of analysis becomes a country . Even inanimate objects can serve as
units of analysis. For instance, if a researcher is interested in understanding how to
make web pages more attractive to its users, then the unit of analysis is a web page
(and not users). If we wish to study how knowledge transfer occurs between two
firms, then our unit of analysis becomes the dyad (the combination of firms that is
sending and receiving knowledge).
Understanding the units of analysis can sometimes be fairly complex. For instance, if
we wish to study why certain neighborhoods have high crime rates, then our unit of
analysis becomes the neighborhood , and not crimes or criminals committing such
crimes. This is because the object of our inquiry is the neighborhood and not
criminals. However, if we wish to compare different types of crimes in different
neighborhoods, such as homicide, robbery, assault, and so forth, our unit of analysis
becomes the crime . If we wish to study why criminals engage in illegal activities,
then the unit of analysis becomes the individual (i.e., the criminal). Like, if we want to
study why some innovations are more successful than others, then our unit of
analysis is an innovation . However, if we wish to study how some organizations
innovate more consistently than others, then the unit of analysis is the organization .
Hence, two related research questions within the same research study may have two
entirely different units of analysis.
Understanding the unit of analysis is important because it shapes what type of data
you should collect for your study and who you collect it from. If your unit of analysis
is a web page, you should be collecting data about web pages from actual web
pages, and not surveying people about how they use web pages. If your unit of
analysis is the organization, then you should be measuring organizational-level
variables such as organizational size, revenues, hierarchy, or absorptive capacity.
This data may come from a variety of sources such as financial records or surveys of
Chief Executive Officers (CEO), who are presumed to be representing their
organization (rather than themselves). Some variables such as CEO pay may seem
like individual level variables, but in fact, it can also be an organizational level
variable because each organization has only one CEO pay at any time. Sometimes,
it is possible to collect data from a lower level of analysis and aggregate that data to
a higher level of analysis. For instance, in order to study teamwork in organizations,
you can survey individual team members in different organizational teams, and
average their individual scores to create a composite team-level score for team-level
variables like cohesion and conflict. We will examine the notion of “variables” in
greater depth in the next section.
Concepts may also have progressive levels of abstraction. Some concepts such as a
person’s weight are precise and objective, while other concepts such as a person’s
personality may be more abstract and difficult to visualize. A construct is an abstract
concept that is specifically chosen (or “created”) to explain a given phenomenon. A
construct may be a simple concept, such as a person’s weight , or a combination of
a set of related concepts such as a person’s communication skill , which may consist
of several underlying concepts such as the person’s vocabulary, syntax , and
spelling . The former instance (weight) is a unidimensional construct , while the latter
(communication skill) is a multi-dimensional construct (i.e., it consists of multiple
underlying concepts). The distinction between constructs and concepts are clearer in
multi-dimensional constructs, where the higher order abstraction is called a construct
and the lower order abstractions are called concepts. However, this distinction tends
to blur in the case of unidimensional constructs.
Constructs used for scientific research must have precise and clear definitions that
others can use to understand exactly what it means and what it does not mean. For
instance, a seemingly simple construct such as income may refer to monthly or
annual income, before-tax or after-tax income, and personal or family income, and is
therefore neither precise nor clear. There are two types of definitions: dictionary
definitions and operational definitions. In the more familiar dictionary definition, a
construct is often defined in terms of a synonym. For instance, attitude may be
defined as a disposition, a feeling, or an affect, and affect in turn is defined as an
attitude. Such definitions of a circular nature are not particularly useful in scientific
research for elaborating the meaning and content of that construct. Scientific
research requires operational definitions that define constructs in terms of how they
will be empirically measured. For instance, the operational definition of a construct
such as temperature must specify whether we plan to measure temperature in
Celsius, Fahrenheit, or Kelvin scale. A construct such as income should be defined
in terms of whether we are interested in monthly or annual income, before-tax or
after-tax income, and personal or family income. One can imagine that constructs
such as learning , personality , and intelligence can be quite hard to define
operationally.
To understand the differences between these different variable types, consider the
example shown in Figure 2.2. If we believe that intelligence influences (or explains)
students’ academic achievement, then a measure of intelligence such as an IQ score
is an independent variable, while a measure of academic success such as grade
point average is a dependent variable. If we believe that the effect of intelligence on
academic achievement also depends on the effort invested by the student in the
learning process (i.e., between two equally intelligent students, the student who puts
is more effort achieves higher academic achievement than one who puts in less
effort), then effort becomes a moderating variable. Incidentally, one may also view
effort as an independent variable and intelligence as a moderating variable. If
academic achievement is viewed as an intermediate step to higher earning potential,
then earning potential becomes the dependent variable for the independent variable
academic achievement , and academic achievement becomes the mediating
variable in the relationship between intelligence and earning potential. Hence,
variable are defined as an independent, dependent, moderating, or mediating
variable based on their nature of association with each other. The overall network of
relationships between a set of related constructs is called a nomological network
(see Figure 2.2). Thinking like a researcher requires not only being able to abstract
constructs from observations, but also being able to mentally visualize a nomological
network linking these abstract constructs.
Figure 2.2 shows how theoretical constructs such as intelligence, effort, academic
achievement, and earning potential are related to each other in a nomological
network. Each of these relationships is called a proposition. In seeking explanations
to a given phenomenon or behavior, it is not adequate just to identify key concepts
and constructs underlying the target phenomenon or behavior. We must also identify
and state patterns of relationships between these constructs. Such patterns of
relationships are called propositions. A proposition is a tentative and conjectural
relationship between constructs that is stated in a declarative form. An example of a
proposition is: “An increase in student intelligence causes an increase in their
academic achievement.” This declarative statement does not have to be true, but
must be empirically testable using data, so that we can judge whether it is true or
false. Propositions are generally derived based on logic (deduction) or empirical
observations (induction).
Also note that scientific hypotheses should clearly specify independent and
dependent variables. In the hypothesis, “students’ IQ scores have positive effects on
their academic achievement,” it is clear that intelligence is the independent variable
(the “cause”) and academic achievement is the dependent variable (the “effect”).
Further, it is also clear that this hypothesis can be evaluated as either true (if higher
intelligence leads to higher academic achievement) or false (if higher intelligence has
no effect on or leads to lower academic achievement). Later on in this book, we will
examine how to empirically test such cause-effect relationships. Statements such as
“students are generally intelligent” or “all students can achieve academic success”
are not scientific hypotheses because they do not specify independent and
dependent variables, nor do they specify a directional relationship that can be
evaluated as true or false.
I must note here that people not familiar with scientific research often view a theory
as a speculation or the opposite of fact . For instance, people often say that teachers
need to be less theoretical and more practical or factual in their classroom teaching.
However, practice or fact are not opposites of theory, but in a scientific sense, are
essential components needed to test the validity of a theory. A good scientific theory
should be well supported using observed facts and should also have practical value,
while a poorly defined theory tends to be lacking in these dimensions. Famous
organizational research Kurt Lewin once said, “Theory without practice is sterile;
practice without theory is blind.” Hence, both theory and facts (or practice) are
essential for scientific research.
As shown in Figure 2.3, inductive and deductive reasoning go hand in hand in theory
and model building. Induction occurs when we observe a fact and ask, “Why is this
happening?”
Our design and conduct of research is shaped by our mental models or frames of
references that we use to organize our reasoning and observations. These mental
models or frames (belief systems) are called paradigms. The word “paradigm” was
popularized by
Thomas Kuhn (1962) in his book The Structure of Scientific Revolutions, where he
examined the history of the natural sciences to identify patterns of activities that
shape the progress of science. Similar ideas are applicable to social sciences as
well, where a social reality can be viewed by different people in different ways, which
may constrain their thinking and reasoning about the observed phenomenon. For
instance, conservatives and liberals tend to have very different perceptions of the
role of government in people’s lives, and hence, have different opinions on how to
solve social problems. Conservatives may believe that lowering taxes is the best way
to stimulate a stagnant economy because it increases people’s disposable income
and spending, which in turn expands business output and employment. In contrast,
liberals may believe that governments should invest more directly in job creation
programs such as public works and infrastructure projects, which will increase
employment and people’s ability to consume and drive the economy. Likewise,
Western societies place greater emphasis on individual rights, such as one’s right to
privacy, right of free speech, and right to bear arms. In contrast, Asian societies tend
to balance the rights of individuals against the rights of families, organizations, and
the government, and therefore tend to be more communal and less individualistic in
their policies. Such differences in perspective often lead Westerners to criticize Asian
governments for being autocratic, while Asians criticize Western societies for being
greedy, having high crime rates, and creating a “cult of the individual.” Our personal
paradigms are like “colored glasses” that govern how we view the world and how we
structure our thoughts about what we see in the world.
Paradigms are often hard to recognize, because they are implicit, assumed, and
taken for granted. However, recognizing these paradigms is key to making sense of
and reconciling differences in people’ perceptions of the same social phenomenon.
For instance, why do liberals believe that the best way to improve secondary
education is to hire more teachers, but conservatives believe that privatizing
education (using such means as school vouchers) are more effective in achieving
the same goal? Because conservatives place more faith in competitive markets (i.e.,
in free competition between schools competing for education dollars), while liberals
believe more in labor (i.e., in having more teachers and schools). Likewise, in social
science research, if one were to understand why a certain technology was
successfully implemented in one organization but failed miserably in another, a
researcher looking at the world through a “rational lens” will look for rational
explanations of the problem such as inadequate technology or poor fit between
technology and the task context where it is being utilized, while another research
looking at the same problem through a “social lens” may seek out social deficiencies
such as inadequate user training or lack of management support, while those seeing
it through a “political lens” will look for instances of organizational politics that may
subvert the technology implementation process. Hence, subconscious paradigms
often constrain the concepts that researchers attempt to measure, their
observations, and their subsequent interpretations of a phenomenon. However,
given the complex nature of social phenomenon, it is possible that all of the above
paradigms are partially correct, and that a fuller understanding of the problem may
require an understanding and application of multiple paradigms.
Two popular paradigms today among social science researchers are positivism and
post-positivism. Positivism , based on the works of French philosopher Auguste
Comte (1798-1857), was the dominant scientific paradigm until the mid-20 th
century. It holds that science or knowledge creation should be restricted to what can
be observed and measured. Positivism tends to rely exclusively on theories that can
be directly tested. Though positivism was originally an attempt to separate scientific
inquiry from religion (where the precepts could not be objectively observed),
positivism led to empiricism or a blind faith in observed data and a rejection of any
attempt to extend or reason beyond observable facts. Since human thoughts and
emotions could not be directly measured, there were not considered to be legitimate
topics for scientific research. Frustrations with the strictly empirical nature of
positivist philosophy led to the development of post-positivism (or postmodernism)
during the mid-late 20 th century. Post-positivism argues that one can make
reasonable inferences about a phenomenon by combining empirical observations
with logical reasoning. Post-positivists view science as not certain but probabilistic
(i.e., based on many contingencies), and often seek to explore these contingencies
to understand social reality better. The post -positivist camp has further fragmented
into subjectivists , who view the world as a subjective construction of our subjective
minds rather than as an objective reality, and critical realists , who believe that there
is an external reality that is independent of a person’s thinking but we can never
know such reality with any degree of certainty.
Burrell and Morgan (1979), in their seminal book Sociological Paradigms and
Organizational Analysis, suggested that the way social science researchers view and
study social phenomena is shaped by two fundamental sets of philosophical
assumptions: ontology and epistemology. Ontology refers to our assumptions about
how we see the world, e.g., does the world consist mostly of social order or constant
change. Epistemology refers to our assumptions about the best way to study the
world, e.g., should we use an objective or subjective approach to study social reality.
Using these two sets of assumptions, we can categorize social science research as
belonging to one of four categories (see Figure 3.1).
If researchers view the world as consisting mostly of social order (ontology) and
hence seek to study patterns of ordered events or behaviors, and believe that the
best way to study such a world is using objective approach (epistemology) that is
independent of the person conducting the observation or interpretation, such as by
using standardized data collection tools like surveys, then they are adopting a
paradigm of functionalism . However, if they believe that the best way to study social
order is though the subjective interpretation of participants involved, such as by
interviewing different participants and reconciling differences among their responses
using their own subjective perspectives, then they are employing an interpretivism
paradigm. If researchers believe that the world consists of radical change and seek
to understand or enact change using an objectivist approach, then they are
employing a radical structuralism paradigm. If they wish to understand social change
using the subjective perspectives of the participants involved, then they are following
a radical humanism paradigm.
Figure 3.1. Four paradigms of social science research (Source: Burrell and Morgan, 1979)
To date, the majority of social science research has emulated the natural sciences,
and followed the functionalist paradigm. Functionalists believe that social order or
patterns can be understood in terms of their functional components, and therefore
attempt to break down a problem into small components and studying one or more
components in detail using objectivist techniques such as surveys and experimental
research. However, with the emergence of post-positivist thinking, a small but
growing number of social science researchers are attempting to understand social
order using subjectivist techniques such as interviews and ethnographic studies.
Radical humanism and radical structuralism continues to represent a negligible
proportion of social science research, because scientists are primarily concerned
with understanding generalizable patterns of behavior, events, or phenomena, rather
than idiosyncratic or changing events. Nevertheless, if you wish to study social
change, such as why democratic movements are increasingly emerging in Middle
Eastern countries, or why this movement was successful in Tunisia, took a longer
path to success in Libya, and is still not successful in Syria, then perhaps radical
humanism is the right approach for such a study. Social and organizational
phenomena generally consists elements of both order and change. For instance,
organizational success depends on formalized business processes, work
procedures, and job responsibilities, while being simultaneously constrained by a
constantly changing mix of competitors, competing products, suppliers, and
customer base in the business environment. Hence, a holistic and more complete
understanding of social phenomena such as why are some organizations more
successful than others, require an appreciation and application of a multi-
The first phase of research is exploration . This phase includes exploring and
selecting research questions for further investigation, examining the published
literature in the area of inquiry to understand the current state of knowledge in that
area, and identifying theories that may help answer the research questions of
interest.
The first step in the exploration phase is identifying one or more research questions
dealing with a specific behavior, event, or phenomena of interest. Research
questions are specific questions about a behavior, event, or phenomena of interest
that you wish to seek answers for in your research. Examples include what factors
motivate consumers to purchase goods and services online without knowing the
vendors of these goods or services, how can we make high school students more
creative, and why do some people commit terrorist acts. Research questions can
delve into issues of what, why, how, when, and so forth. More interesting research
questions are those that appeal to a broader population (e.g., “how can firms
innovate” is a more interesting research question than “how can Chinese firms
innovate in the service-sector”), address real and complex problems (in contrast to
hypothetical or “toy” problems), and where the answers are not obvious. Narrowly
focused research questions (often with a binary yes/no answer) tend to be less
useful and less interesting and less suited to capturing the subtle nuances of social
phenomena. Uninteresting research questions generally lead to uninteresting and
unpublishable research findings.
The next step is to conduct a literature review of the domain of interest. The purpose
of a literature review is three-fold: (1) to survey the current state of knowledge in the
area of inquiry, (2) to identify key authors, articles, theories, and findings in that area,
and (3) to identify gaps in knowledge in that research area. Literature review is
commonly done today using computerized keyword searches in online databases.
Keywords can be combined using “and” and “or” operations to narrow down or
expand the search results. Once a shortlist of relevant articles is generated from the
keyword search, the researcher must then manually browse through each article, or
at least its abstract section, to determine the suitability of that article for a detailed
review. Literature reviews should be reasonably complete, and not restricted to a few
journals, a few years, or a specific methodology. Reviewed articles may be
summarized in the form of tables, and can be further structured using organizing
frameworks such as a concept matrix. A well-conducted literature review should
indicate whether the initial research questions have already been addressed in the
literature (which would obviate the need to study them again), whether there are
newer or more interesting research questions available, and whether the original
research questions should be modified or changed in light of findings of the literature
review. The review can also provide some intuitions or potential answers to the
questions of interest and/or help identify theories that have previously been used to
address similar questions.
The next phase in the research process is research design . This process is
concerned with creating a blueprint of the activities to take in order to satisfactorily
answer the research questions identified in the exploration phase. This includes
selecting a research method, operationalizing constructs of interest, and devising an
appropriate sampling strategy.
Researchers must also carefully choose the target population from which they wish
to collect data, and a sampling strategy to select a sample from that population. For
instance, should they survey individuals or firms or workgroups within firms? What
types of individuals or firms they wish to target? Sampling strategy is closely related
to the unit of analysis in a research problem. While selecting a sample, reasonable
care should be taken to avoid a biased sample (e.g., sample based on convenience)
that may generate biased observations. Sampling is covered in depth in a later
chapter.
At this stage, it is often a good idea to write a research proposal detailing all of the
decisions made in the preceding stages of the research process and the rationale
behind each decision. This multi-part proposal should address what research
questions you wish to study and why, the prior state of knowledge in this area,
theories you wish to employ along with hypotheses to be tested, how to measure
constructs, what research method to be employed and why, and desired sampling
strategy. Funding agencies typically require such a proposal in order to select the
best proposals for funding. Even if funding is not sought for a research project, a
proposal may serve as a useful vehicle for seeking feedback from other researchers
and identifying potential problems with the research project (e.g., whether some
important constructs were missing from the study) before starting data collection.
This initial feedback is invaluable because it is often too late to correct critical
problems after data is collected in a research study.
Having decided who to study (subjects), what to measure (concepts), and how to
collect data (research method), the researcher is now ready to proceed to the
research execution phase. This includes pilot testing the measurement instruments,
data collection, and data analysis.
Pilot testing is an often overlooked but extremely important part of the research
process. It helps detect potential problems in your research design and/or
instrumentation (e.g., whether the questions asked is intelligible to the targeted
sample), and to ensure that the measurement instruments used in the study are
reliable and valid measures of the constructs of interest. The pilot sample is usually a
small subset of the target population. After a successful pilot testing, the researcher
may then proceed with data collection using the sampled population. The data
collected may be quantitative or qualitative, depending on the research method
employed.
Following data collection, the data is analyzed and interpreted for the purpose of
drawing conclusions regarding the research questions of interest. Depending on the
type of data collected (quantitative or qualitative), data analysis may be quantitative
(e.g., employ statistical techniques such as regression or structural equation
modeling) or qualitative (e.g., coding or content analysis).
The final phase of research involves preparing the final research report documenting
the entire research process and its findings in the form of a research paper,
dissertation, or monograph. This report should outline in detail all the choices made
during the research process (e.g., theory used, constructs selected, measures used,
research methods, sampling, etc.) and why, as well as the outcomes of each phase
of the research process. The research process must be described in sufficient detail
so as to allow other researchers to replicate your study, test the findings, or assess
whether the inferences derived are scientifically acceptable. Of course, having a
ready research proposal will greatly simplify and quicken the process of writing the
finished report. Note that research is of no value unless the research process and
outcomes are documented for future generations; such documentation is essential
for the incremental progress of science.
The research process is fraught with problems and pitfalls, and novice researchers
often find, after investing substantial amounts of time and effort into a research
project, that their research questions were not sufficiently answered, or that the
findings were not interesting enough, or that the research was not of “acceptable”
scientific quality. Such problems typically result in research papers being rejected by
journals. Some of the more frequent mistakes are described below.
Pursuing research fads. Another common mistake is pursuing “popular” topics with
limited shelf life. A typical example is studying technologies or practices that are
popular today. Because research takes several years to complete and publish, it is
possible that popular interest in these fads may die down by the time the research is
completed and submitted for publication. A better strategy may be to study “timeless”
topics that have always persisted through the years.
Blind data mining. Some researchers have the tendency to collect data first (using
instruments that are already available), and then figure out what to do with it. Note
that data collection is only one step in a long and elaborate process of planning,
designing, and executing research. In fact, a series of other activities are needed in a
research process prior to data collection. If researchers jump into data collection
without such elaborate planning, the data collected will likely be irrelevant, imperfect,
or useless, and their data collection efforts may be entirely wasted. An abundance of
data cannot make up for deficits in research planning and design, and particularly,
for the lack of interesting research questions.
Theories should explain why things happen, rather than just describe or predict. Note
that it is possible to predict events or behaviors using a set of predictors, without
necessarily explaining why such events are taking place. For instance, market
analysts predict fluctuations in the stock market based on market announcements,
earnings reports of major companies, and new data from the Federal Reserve and
other agencies, based on previously observed correlations . Prediction requires only
correlations. In contrast, explanations require causations , or understanding of
cause-effect relationships. Establishing causation requires three conditions: (1)
correlations between two constructs, (2) temporal precedence (the cause must
precede the effect in time), and (3) rejection of alternative hypotheses (through
testing). Scientific theories are different from theological, philosophical, or other
explanations in that scientific theories can be empirically tested using scientific
methods.
However, theories can also have their own share of limitations. As simplified
explanations of reality, theories may not always provide adequate explanations of
the phenomenon of interest based on a limited set of constructs and relationships.
Theories are designed to be simple and parsimonious explanations, while reality
may be significantly more complex. Furthermore, theories may impose blinders or
limit researchers’ “range of vision,” causing them to miss out on important concepts
that are not defined by the theory.
David Whetten (1989) suggests that there are four building blocks of a theory:
constructs, propositions, logic, and boundary conditions/assumptions. Constructs
capture the “what” of theories (i.e., what concepts are important for explaining a
phenomenon), propositions capture the “how” (i.e., how are these concepts related
to each other), logic represents the “why” (i.e., why are these concepts related), and
boundary conditions/assumptions examines the “who, when, and where” (i.e., under
what circumstances will these concepts and relationships work). Though constructs
and propositions were previously discussed in Chapter 2, we describe them again
here for the sake of completeness.
Constructs are abstract concepts specified at a high level of abstraction that are
chosen specifically to explain the phenomenon of interest. Recall from Chapter 2 that
constructs may be unidimensional (i.e., embody a single concept), such as weight or
age, or multi-dimensional (i.e., embody multiple underlying concepts), such as
personality or culture. While some constructs, such as age, education, and firm size,
are easy to understand, others, such as creativity, prejudice, and organizational
agility, may be more complex and abstruse, and still others such as trust, attitude,
and learning, may represent temporal tendencies rather than steady states.
Nevertheless, all constructs must have clear and unambiguous operational definition
that should specify exactly how the construct will be measured and at what level of
analysis (individual, group, organizational, etc.). Measurable representations of
abstract constructs are called variables . For instance, intelligence quotient (IQ
score) is a variable that is purported to measure an abstract construct called
intelligence. As noted earlier, scientific research proceeds along two planes: a
theoretical plane and an empirical plane. Constructs are conceptualized at the
theoretical plane, while variables are operationalized and measured at the empirical
(observational) plane. Furthermore, variables may be independent, dependent,
mediating, or moderating, as discussed in Chapter 2. The distinction between
constructs (conceptualized at the theoretical level) and variables (measured at the
empirical level) is shown in Figure 4.1.
The third building block of a theory is the logic that provides the basis for justifying
the propositions as postulated. Logic acts like a “glue” that connects the theoretical
constructs and provides meaning and relevance to the relationships between these
constructs. Logic also represents the “explanation” that lies at the core of a theory.
Without logic, propositions will be ad hoc, arbitrary, and meaningless, and cannot be
tied into a cohesive “system of propositions” that is the heart of any theory.
Finally, all theories are constrained by assumptions about values, time, and space,
and boundary conditions that govern where the theory can be applied and where it
cannot be applied. For example, many economic theories assume that human
beings are rational (or boundedly rational) and employ utility maximization based on
cost and benefit expectations as a way of understand human behavior. In contrast,
political science theories assume that people are more political than rational, and try
to position themselves in their professional or personal environment in a way that
maximizes their power and control over others. Given the nature of their underlying
assumptions, economic and political theories are not directly comparable, and
researchers should not use economic theories if their objective is to understand the
power structure or its evolution in a organization. Likewise, theories may have
implicit cultural assumptions (e.g., whether they apply to individualistic or collective
cultures), temporal assumptions (e.g., whether they apply to early stages or later
stages of human behavior), and spatial assumptions (e.g., whether they apply to
certain localities but not to others). If a theory is to be properly used or tested, all of
its implicit assumptions that form the boundaries of that theory must be properly
understood. Unfortunately, theorists rarely state their implicit assumptions clearly,
which leads to frequent misapplications of theories to problem situations in research.
Theories are simplified and often partial explanations of complex social reality. As
such, there can be good explanations or poor explanations, and consequently, there
can be good theories or poor theories. How can we evaluate the “goodness” of a
given theory? Different criteria have been proposed by different researchers, the
more important of which are listed below:
The fourth approach is to apply existing theories in entirely new contexts by drawing
upon the structural similarities between the two contexts. This approach relies on
reasoning by analogy, and is probably the most creative way of theorizing using a
deductive approach. For instance, Markus (1987) [3] used analogic similarities
between a nuclear explosion and uncontrolled growth of networks or network-based
businesses to propose a critical mass theory of network growth. Just as a nuclear
explosion requires a critical mass of radioactive material to sustain a nuclear
explosion, Markus suggested that a network requires a critical mass of users to
sustain its growth, and without such critical mass, users may leave the network,
causing an eventual demise of the network.
In this section, we present brief overviews of a few illustrative theories from different
social science disciplines. These theories explain different types of social behaviors,
using a set of constructs, propositions, boundary conditions, assumptions, and
underlying logic. Note that the following represents just a simplistic introduction to
these theories; readers are advised to consult the original sources of these theories
for more details and insights on each theory.
Agency Theory. Agency theory (also called principal-agent theory), a classic theory
in the organizational economics literature, was originally proposed by Ross
(1973) [4] to explain two-party relationships (such as those between an employer and
its employees, between organizational executives and shareholders, and between
buyers and sellers) whose goals are not congruent with each other. The goal of
agency theory is to specify optimal contracts and the conditions under which such
contracts may help minimize the effect of goal incongruence. The core assumptions
of this theory are that human beings are self-interested individuals, boundedly
rational, and risk-averse, and the theory can be applied at the individual or
organizational level.
The two parties in this theory are the principal and the agent; the principal employs
the agent to perform certain tasks on its behalf. While the principal’s goal is quick
and effective completion of the assigned task, the agent’s goal may be working at its
own pace, avoiding risks, and seeking self-interest (such as personal pay) over
corporate interests. Hence, the goal incongruence. Compounding the nature of the
problem may be information asymmetry problems caused by the principal’s inability
to adequately observe the agent’s behavior or accurately evaluate the agent’s skill
sets. Such asymmetry may lead to agency problems where the agent may not put
forth the effort needed to get the task done (the moral hazard problem) or may
misrepresent its expertise or skills to get the job but not perform as expected (the
adverse selection problem). Typical contracts that are behavior-based, such as a
monthly salary, cannot overcome these problems. Hence, agency theory
recommends using outcome-based contracts, such as a commissions or a fee
payable upon task completion, or mixed contracts that combine behavior-based and
outcome-based incentives. An employee stock option plans are is an example of an
outcome-based contract while employee pay is a behavior-based contract. Agency
theory also recommends tools that principals may employ to improve the efficacy of
behavior-based contracts, such as investing in monitoring mechanisms (such as
hiring supervisors) to counter the information asymmetry caused by moral hazard,
designing renewable contracts contingent on agent’s performance (performance
assessment makes the contract partially outcome-based), or by improving the
structure of the assigned task to make it more programmable and therefore more
observable.
TPB is an extension of an earlier theory called the theory of reasoned action, which
included attitude and subjective norm as key drivers of intention, but not behavioral
control. The latter construct was added by Ajzen in TPB to account for
circumstances when people may have incomplete control over their own behaviors
(such as not having high-speed Internet access for web surfing).
Figure 4.4. Innovation adoption process.
Whether people will be influenced by the central or peripheral routes depends upon
their ability and motivation to elaborate the central merits of an argument. This ability
and motivation to elaborate is called elaboration likelihood . People in a state of high
elaboration likelihood (high ability and high motivation) are more likely to thoughtfully
process the information presented and are therefore more influenced by argument
quality, while those in the low elaboration likelihood state are more motivated by
peripheral cues. Elaboration likelihood is a situational characteristic and not a
personal trait. For instance, a doctor may employ the central route for diagnosing
and treating a medical ailment (by virtue of his or her expertise of the subject), but
may rely on peripheral cues from auto mechanics to understand the problems with
his car. As such, the theory has widespread implications about how to enact attitude
change toward new products or ideas and even social change.