FDRE Technical and Vocational Institute

Information Technology (MSc Program)

Research Methods In Technology

BY
Mohammed Tune(Asst. Prof)
1
 Outline

• Introduction
• Definition of research
• Objectives of Research
• Types of research
• Characteristics of Research
2
• The Research Process
3 Research Requires?

 Every thing which is really great and

inspiring created by the individual who
can labour in freedom-Einstein
 Why Research Methods in Computing?
4
 Most of the Informatics (CS, IT, SE & IS)
curriculum teaches:
• how to be a good programmer and engineer (e.g., computer programming, software
engineering, and object-oriented design),
• how to think about problems abstractly (e.g., algorithms, data structures, theory of
network & data communication, and automata theory),
• how computing can be applied to solve various problems (e.g., vision, speech and
language processing, and transaction processing systems),
• How to design an intelligent systems (Artificial Intelligence, Expert systems,
Knowledge based system)or
• how computer systems work (e.g., operating systems, compiler, computer
architecture, …).

 This course takes the view that computer programs

are complex systems that need to be studied by
conducting controlled experiments:
 to measure their performance; using accuracy,
running time, memory space requirement.
 Fundamentals of Research
 Definition: What research is?
Research can be defined as:

Search for new knowledge (i.e. original contribution

of knowledge to mankind)
It is a systematic investigation (i.e., the gathering and analysis
of information) to increase our understanding of the
phenomenon.
a scientific, and systematic search for relevant
5
information on a specific topic
It is an art of scientific investigation.
 Science is about fact. Art is about arguing meanings, feelings, and
contesting views.
 CONT…
6  Research is an Organized and Systematic way of
Finding answers to Questions
Systematic:
Means there is a definite set of procedures and steps which
you will follow. There are certain things in the research
process which are always done in order to get the most
accurate results.
Organized:
means there is a structured or method in going about doing
research.
It is a planned procedure, not a spontaneous one.
It is focused and limited to a specific scope.
 Cont…
7
 It is actually a voyage of discovery from the known to the

unknown.
 Research is an attempt to search for truth.

 Research = Re + Search
To find out something,

Re’ means again and again

 Therefore, research means a process of observing the phenomena

again and again from different dimensions and collects the data so as
to draw some conclusions
 What research is not?
8

Research is not only information gathering.

 Gathering information from resources such as
books or magazines isn’t research.
Research is not transformation of facts
from one location to another.
 Merely transporting facts from one resource to
another doesn’t constitute research.
 No contribution to new knowledge
 Collecting data, assembling reference materials,
and referring statements properly do not add up to a
true research.
9
 Why Research?
10
o To discover answers to questions through the
application of scientific procedures,
o Original contribution of knowledge to
mankind
o To find out the truth which is hidden which
has not been discovered as yet.
o is to reduce, or even eliminate uncertainty
 Cont…
11
 To gain familiarity with a phenomenon or to
achieve new insights into(exploratory research )
 To describe accurately the characteristics of a
particular individual, situation or a group( descriptive
research )

 To test a hypothesis of a causal relationship

between variables
 Motivation of doing research
12
What makes people to undertake research?
 Desire to get a research degree along with its
consequential benefits;
 Desire to face the challenge in solving the unsolved
problems
 Desire to get intellectual joy of doing some creative work
 Desire to be of service to society.
 by increasing standard of living in case of Science & Technology, and
 by showing the right path in case of Social and Behavioral Sciences

 Desire to get respectability.

 Goal of Research
13

 The three major goals of research are

• defining the prevailing situation
• analyzing & interpreting information/data, and
• reaching new conclusions.
 The three main acts of doing research are searching for,
reviewing, and evaluating information.

Implicit question + data to answer the question + Explicit

answer
 Qualities of a good research
14

Good research is:

 Systematic
 it uses a rational process or method

 Logical
 Guided by rules of logical reasoning & logical process of induction & deduction

 Empirical
 based on evidence or data
 It provides a basis for external validity to results (validation)

 Replicable
 produce the same results if repeated exactly.
 So it will help to verify and confirm the study
 Research Methods vs Methodology
15
Method
o It is a techniques that are used for conduction of research

o refer to the behavior and instruments used in selecting and

constructing research technique.

o E.g. Analysis of historical records, Participants observation,

o Mail Questionnaire ,interviews

Methodology
o A way to systematically solve the research problem.
o A science of studying how research is done scientifically.
o Helps to know which methods or techniques, are relevant
and which are not, and what would they mean and indicate
and why we use this method.
o The philosophy of conducting research in scientific method
 Scientific Method
16
• The Scientific Method can be defined as a sequence
of steps for systematically analyzing scientific questions.
Such steps include;
– Researching previous studies and current data to pose Research Questions for the
current study.
– Designing a Research “Protocol /Framework” to answer the research questions.
– Executing the research to create reproducible results.
• A way to systematically solve the research problem by logically adopting various steps
• Common philosophy for any kind of research
17 Is Research is same as Project?

 A project is where you apply the theories that you've

learned to practice, where as a research goes a little
beyond that.
 you apply existing theories (you’ve learned) but will be
coming up with new theories or concepts of your own.
 you will have to experiment new scenario, interpret it
and come up with findings in your study.
 You know the output (movement from known to known)
 you cannot be certain of the result till you are done
with your research
 TYPES OF RESEARCH
There are different bases in classifying researches; however we will see only the most common bases

 On the basis of the outcome of the research: Basic and

applied research

 On the basis of source of data: Primary and secondary

 On the bases of the purpose why it is conducted: explorator,

Descriptive, explanatory, Predictive research, Correlational

18 Research

 On the basis of the information used in the study:

Qualitative and Quantitative, etc.

19 Types of research based on
outcome
 Research could be undertaken to solve:
 Theoretical problems – basic research.
 practical problems – applied research.

Excavating Human Behaviors

20 Basic research
 Also known as pure or fundamental research
Objective:
 Advancement of knowledge(formulating or expanding theory)
 Understanding of theoretical relationship between variables

 Exploratory in nature (discovery of knowledge)

 Requires rigorous and structured type of analysis
 Usually without any practical end in mind
 Research concerning some natural phenomenon or relating to pure mathematics are
examples of fundamental research.
 Applied research
21
 is also called field research, evaluation research, or action
research
 Solve specific, practical questions
 Aims at finding a solution for an immediate problem
facing a society or an industrial/business organization
 Employs methodology that is not as rigorous as that of basic
research.
 Yields findings that can be evaluated in terms of local
applicability and not in terms of universal validity.
 The purpose of research is testing theories and apply it to
real situations.
 Most new research questions originate from theories.
 Researchers of all disciplines use theories to help
them describe facts.
 Theories are strengthened by test results
 Types of research On the basis of source of data
22
 Primary and secondary research
Primary/ field research – the collection of data that does not already exist.

Primary Data: data collected from participants

through methods such as telephone, mail, online,
and face-to-face (quantitative), and observation
studies and focus groups (qualitative)
Secondary/desk research – the summary, collection and/or synthesis of
existing research
Secondary Data: accessing data through sources such as the internet and
library
23 On the bases of the purpose why it
is conducted:
 Exploratory research: also called preliminary research.
 is most commonly unstructured, “informal” research that
is undertaken to gain background information about the
general nature of the research problem.
 Exploratory research is usually conducted when the
researcher does not know much about the problem and
needs:
 additional information or desires new or more recent
information.
•To define terms
•To clarify problems and hypotheses
•To establish research priorities
24 Cont.

 provides significant insight into a given situation but not usually

useful for decision making by itself.
 helps to determine the best research design, data collection
method and selection of subjects.
 On the bases of the purpose why it is conducted:
25
Empirical

 It finds a solution empirically (based on observation and

experience more than upon theory and abstraction). i.e.
the research bases its findings on direct or indirect
observation as its test of reality.
 Relies on experience or observation alone, often without
due regard for system and theory.
 It is data-based research, coming up with conclusions
which are capable of being verified by observation or
experiment
 It can be qualitative & quantitative.
 Empirical & theoretical/conceptual research
complements each other in developing an understanding
of the phenomena, in predicting future events.
 On the bases of the purpose why it is
conducted:
26
Experimental Research
 An experiment is a research situation where at
least one independent variable, called the
experimental variable, is deliberately
manipulated or varied by the researcher.
 Control group and experimental group
 Explores cause and effect relationships.
 It is common in medical and agricultural
sciences.
27 Predictive research

 goes beyond explaining why and how things happened.

 It predicts (forecast) the possible (probability) of happening
similar situation in other places.
 Descriptive research
28

 The main purpose of descriptive research is to describe the

state of view as it exists at present. Simply stated, it is a fact
finding investigation.
The main characteristic:
 Researcher has no control over the variables; he can only
report what has happened or what is happening
 Descriptive research deals with demographic
characteristics of the consumer.
 For example, trends in the consumption of soft drink
with respect to;
 socio-economic characteristics such as age,
family, income, education level etc.
29 The following are the main objectives of
descriptive research:

• To identify present conditions and point to

present needs.
• To study immediate status of a phenomenon.
• Fact findings.
• To examine the relationships of traits and
characteristics (trends and patterns).
• To find answers to the questions “what, who
and where”.
 On the basis of the information used in the
study: or approaches
30

 Two basic approaches to research

 Quantitative approach and the Qualitative

approach
 Quantitative methods are identified with the so-
called ‘‘hard science’’ disciplines, whereas
qualitative methods, with the social sciences.
 Qualitative
31
 Qualitative research involves studies that do not attempt to
quantify their results through statistical summary or
analysis.
 Qualitative research is research undertaken to gain insights
concerning attitudes, beliefs, motivations and behaviors of
individuals to explore a social or human problem
 phenomena relating to or involving quality or kind.
 investigating the reasons for human behavior (i.e., why
people think or do
 concerned with subjective assessment of attitudes,
opinions and behavior
 Often the goal of qualitative research is to look for
meaning.
 It typically involves methods such as focus groups, in-depth
interviews, observation research and case studies.
32 Quantitative


The measurement of quantity or amount
 The objective of quantitative research is to develop and employ
mathematical models, theories and hypotheses pertaining to
natural phenomena.
 It tends to move from the general to the specific
 The process of measurement is central to quantitative research
because it provides the fundamental connection between
empirical/practical observation and mathematical expression
of an attribute.
 This approach typically concentrates on measuring or counting
and involves collecting and analyzing numerical data and
applying statistical tests.
 Research Processes

33
 Research process consists of series of actions or steps
necessary to effectively carry out research and the
desired sequencing of these steps.
 Research is originates or guided by the specific
research problem, question or hypothesis.
 Research requires clear articulation of a goal.
 Research requires a specific plan for proceeding.
methodology (research design)
 Research usually divides the principal problem into
more manageable sub problems.
 Research is by its nature cyclical.
34 Steps of the research process
 1. Generating research ideas
• Generating ideas comes form identifying a problem.

• Problem means there is dispute, controversy, debate

or disagreement that needs to be addressed or
answered.
• Where does one can find problems?

35 The problems are all around you.

It is issue in literature.
• It is the first step towards becoming a mature
researcher.
 Statement of the problem”
If you want to solve a problem, you must know what
2.
is the Formulate
problem. the
research problem
An important step in the research process.
 The problem should simple, clear and complete
36 Clearly stated problem is half solved
 .
3 Develop hypotheses or Research questions

Breakdown the problem into sub-problems

called hypotheses or research question
It guides the selection of appropriate
research method, data collection techniques,
data analysis techniques.
It should be clearly stated and you should be
ready to defend or support
37
  Hypotheses or research question will determine the
design of study
 The methodology selected depends on the research
problem and hypotheses.
 First
4. Design study
identifying to testthen
problem, hypotheses or
select methodology.

38
Research Questions
 5. Collect Data
Collecting data that helps to answer the question
asked
There are different types of data collection
method.
 Interview
 Questioners
39
 Observation
 Literature review
 There are two types of data
40 Primary Data:
 Are those data, which are collected by the
investigator himself for the purpose of a specific
inquiry or study.
 Such data are original in character and are mostly
generated by surveys conducted by individuals or
research institutions.
Secondary Data:
 Are those data which have already been collected
and analyzed by someone else and which have
passed through the statistical process.
 Such data are primary data for the agency that
collected them, and become secondary for someone
else who uses these data for his own purposes.
  Secondary data can be obtained from journals,
41
reports, government publications, publications of
professionals and research organizations.
 Secondary data are less expensive to collect both
in money and time.
Methods of Primary Data Collection:
 Primary data obtained either through
observation or through direct communication
with respondents in one form or another or
through personal interviews.
42
Cont…
 while in case of secondary data the nature of data
collection work is merely that of compilation.
 There are several methods of collecting primary da
ta,
particularly in surveys and descriptive researches.
Important ones are:
i. Observation method,
ii. Interview method,
iii. Questionnaires ,
 i. Observation method,
43
 Itis the gathering of primary data by investigator’s
own direct observation of relevant situations
without asking from the respondent.
 The aim is to gather data or information about the
world as it is.
 So you hope the act of studying doesn't substantially
modify the thing you are interested in.
 Observation can yield information which people are
normally unwilling or unable to provide.
44
Advantage:
 The main advantage of this method is that subject
ive bias is
eliminated, if observation is done accurately.
 Secondly, the information obtained under this
method relates to what is currently happening;
 it is not complicated by either the past
behavior or future intentions or attitudes.
 Thirdly, this method is independent of
respondents’ willingness to respond
  Limitations:
 feelings, beliefs and attitudes cannot be observed.
45
 expensive method
II. Interview method
 It is a verbal face-to-face discussion or communication
via some technology like the telephone or computer
between an interviewer and a respondent.
Unstructured: It allows a free flow of communication in the
course of the interview or questionnaire administration.
Structured: where the information that needs to be collected
from the respondents is already decided.
Semi-structured: Restricts certain kinds of communications but
allows maneuvering freedom on the discussion of certain
 III. Questionnaires
46
 This method of data collection is quite popular, particularly in cas

e of big investigations.

 The questionnaire is mailed (usually by post) to respondents who

are expected to read, understand and write down the reply in the

space meant for the purpose in the questionnaire itself.

Type of Question
1. Open-ended questions: Type of questions that do not have pre-coded
options (answers).
2. Dichotomous questions: Dichotomous questions have two possible
answers like yes/no, true/false or agree/disagree responses.
3. Multiple-response questions: Type of questions has many probable
 7. Analyze and Interpret Data
This can be one of the difficult task in research, and of
course the crucial one to come up with research findings.
The researcher analyze using statistical techniques and
interprets the newly analyzed data and suggests a
conclusion.
Keep in mind that data analysis that suggests a correlation
47
between two variables can’t automatically be interpreted
as suggesting causality between those variables.
48 Cont…
Depending on whether the research questions are
answered or not, the researcher may be forced to cycle
back to an earlier step in the process and begin again
with a new research questions formulation.
This is one of the self-correcting mechanisms
associated with the scientific method.
 Analyze the performance achieved:
 using performance measures such as accuracy,
recall, precision, etc.
 cont…
49  How do you do Experimental Research?
 Interpret
 Relate performance registered with the
algorithms vs. datasets used
 Show clearly the strength and weakness of the
study, algorithms selected
 Be Careful:
 Better to admit to flaws in your methodology
 Don’t generalize without adequate support
 Report everything:
 Procedures followed, results achieved and
conclusions
 So that others can replicate the experiment, and
build on your conclusions
 Performance evaluation

 Confusion matrix
 performance Measurements
 Confusion matrix
 Condition as determined by Gold
standard
 True  False

→
True  True positive  False positive Positive predictive
value
Test
or Precision
outcome
 False →
False  True negative
negative Negative predictive
value

↓ ↓
Accuracy
Sensitivity or rec Specificity (or its co
all mplement, Fall-Out)

51
 Performance Indicators
•Test efficiency
– Algorithm analysis in terms of running time and memory space
requirement
• Accuracy
– is a measure of how well a system correctly identifies. That is, the
accuracy is the proportion of true results (both true positives and
true negatives) in the population.

• Precision (or positive predictive value)

– is defined as the proportion of the true positives against all the
positive results (both true positives and false positives)

• Recall
– precision is the fraction of retrieved instances that are
relevant/correctly classified, while recall is the fraction of
52
relevant/correct instances that are retrieved.
 Performance Indicators

X 100%

Specificity = True Negative

X 100%
True Negative + False Positive

Precision = True Positive X 100%

True Positive + False Positive
Recall = True Positive X 100%
True Positive + False Negative
 8. Communicate Results
•The output should be communicate to the
community of fellow researchers and practitioners
through.
• Presentation
54 • Journals
• Thesis
• Research papers
55

Thanks ! ! !