Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                

Lecture 3_bk10a1201 Research Methods and Reliability

Download as pptx, pdf, or txt
Download as pptx, pdf, or txt
You are on page 1of 21

Research

methods and
reliability
Lecture 3

Dr. Harri Eskelinen


Issues dealing with
research methods
• Qualitative methods
• Quantitative methods
• Developed measuring algorithms and methods
• Reliability, validity and sensitivity aspects
• Error, saturation and accuracy analysis
Some guidelines:
• Remember to describe the methods so that it would be possible to repeat the
research exactly in the same way based on the description in the research
plan.
• The key-point is to ensure that the described methods and methodologies can
be utilized to answer to the research questions and to solve the research
problem.
• Describe both the practical measurements or other ways to collect data and
how the data will be analyzed.
• Remember to describe reliability and validity analyses.
• Do not forget to describe the sensitivity analysis.
• Note that error and saturation analyses are not the sama as sensitivity or
reliability analyses.
• Remember to take care of required accuracy during the measurements and
calculations.
• Try to utilize methods and approached which are well-known inside the
scientific community or which are even standardized procedures.
• It is recommended that triangulation is utilized in cases where it is
reasonable.
• Qualitative • Quantitative
1 0.02 -1.1 100 A

2 0.04 1.2 110 A

3 0.01 -1.2 80 B

4 N/A 1.0 70 B

5 0.02 0.0 71 C

6 0.04 2.0 74 C

7 0.07 -2.2 75 N/A

8 0.01 -2.4 77 A

9 0.00 -0.5 79 A

10 0.00 -0.5 79 A
Research topic Qualitative research Quantitative research
(simplified) set up set up

Effectiveness of the What kinds of challenges How many % did the


production line’s and advantages were production costs
implementation observed during the first decrease during the first
process year after the production year because of the
line’s implementation? production line’s
implementation?
Research topic Qualitative research Quantitative research
(simplified) set up set up

Effectiveness of the What kinds of challenges How many % did the


production line’s and advantages were production costs
implementation observed during the first decrease during the first
process year after the production year because of the
line’s implementation? production line’s
implementation?

Importance of web- What kinds of aspects How much did sales


based marketing have motivated customers increase during the last
campaign to increase to participate to the month after the new web-
the sales of a new discussions about the new based marketing
technical product product in social media campaign
during the marketing
campaign?
Research topic Qualitative research Quantitative research
(simplified) set up set up

Effectiveness of the What kinds of challenges How many % did the


production line’s and advantages were production costs
implementation observed during the first decrease during the first
process year after the production year because of the
line’s implementation? production line’s
implementation?

Importance of web- What kinds of aspects How much did sales


based marketing have motivated customers increase during the last
campaign to increase to participate to the month after the new web-
the sales of a new discussions about the new based marketing
technical product product in social media campaign
during the marketing
campaign?
Relationship between Why A affects B? How A affects B?
two variables A and B
(A= product’s technical
performance and B=
product’s
manufacturing costs)
Case: Stepwise approach for quantitative
analysis

1. Frequencies for 2. Absolute 3. Probability 4. Tests for normal


each group probabilities distributions distributions

5. Tests to find better 6. Correlations and 7. Curve fitting to 8. Error analysis


probability other characteristics describe correlations
distribution curves to describe and for building
relationships estimation models
between variables 9. Results based on
quantitative analysis
to support possible
qualitative analysis
Typical quantitative
approaches in engineering:
• Mathematical modeling (sometimes combined with
scale models)
• Technical calculations combined with simulations
and virtual modelling
• Laboratory tests with numerical analysis of
measured data
• Statistical analyses
Typical qualitative
approaches in engineering:
• Customers’ satisfaction inquiries and interviews
dealing with a new product’s testing phase or a
prototype development
• Utilization of specialists or experts to formulate the
new multidisciplinary development programs for
sustainable science or energy technology
applications
• Saving and handling personnel’s tacit knowledge in
industrial companies
THEORY
TRIANGULATION

TRIANGULATIONS

METHODS SOURCES
TRIANGULATION TRIANGULATION

RESEARCHERS
TRIANGULATION
Laboratory tests

3
B C

Triangulation
Literature search
Delfoi interview

1 2
A

1 2 3 A B C
Three independent Three comparisons
data sources during verification
Team of experts

1st interview

2nd interview

3rd interview

Collected Collected Collected


comments 1 comments 2 comments 3

Report

Version 1

Researcher
Version 2
Interviewer

DELFOI INTERVIEW Version 3


Reliability
analysis

Have you
measured the
results in the
right way?
Reliability Validity
analysis analysis

Have you Have your


measured the measured the
results in the right thing?
right way?
Reliability Validity Error
analysis analysis analysis

Have you Have your What is the


measured the measured the calculated
results in the right thing? range of
right way? results’
mathematical
error?
Reliability Validity Error Accuracy
analysis analysis analysis analysis

Have you Have your What is the How many


measured the measured the calculated decimals can
results in the right thing? range of be used to
right way? results’ measure and
mathematical calculate the
error? results?
Reliability Validity Error Accuracy Sensitivity
analysis analysis analysis analysis analysis

Have you Have your What is the How many What is the
measured the measured the calculated decimals can critical sample
results in the right thing? range of be used to size which
right way? results’ measure and affects or
mathematical calculate the changes the
error? results? conclusions?
Reliability Validity Error Accuracy Sensitivity Saturation
analysis analysis analysis analysis analysis analysis

Have you Have your What is the How many What is the Have you
measured the measured the calculated decimals can critical sample collected
results in the right thing? range of be used to size which enough data
right way? results’ measure and affects or or
mathematical calculate the changes the observations
error? results? conclusions? to be able to
make
conclusions?
Reliability Validity Error Accuracy Sensitivity Saturation
analysis analysis analysis analysis analysis analysis

Have you Have your What is the How many What is the Have you
measured the measured the calculated decimals can critical sample collected
results in the right thing? range of be used to size which enough data
right way? results’ measure and affects or or
mathematical calculate the changes the observations
error? results? conclusions? to be able to
make
conclusions?
Sensitivity analysis

You might also like