Sample Size For MSA
Sample Size For MSA
Study
2 Previous Study
4 Results
Two Factors Crossed
Two Factors Nested
5 Conclusions
σp2 σp2
ρ= =
σp2 + σe2 σx2
σp2 σp2
ρ= =
σp2 + σe2 σx2
EMP Classifications:
Classification ρ̂ Probability of Warning*
First Class 0.80 − 1.00 0.99 − 1.00
Second Class 0.50 − 0.80 0.88 − 0.99
Third Class 0.20 − 0.50 0.40 − 0.88
Fourth Class 0.00 − 0.20 0.03 − 0.40
* Probability of a warning for a 3σp shift within 10 subgroups using
Test 1.
AIAG Classifications:
Classification %GRR ρ̂
Acceptable 0% − 10% 0.99 − 1.00
Marginal 10% − 30% 0.91 − 0.99
Unacceptable 30% − 100% 0.00 − 0.91
How does sample size affect our ability to estimate the variance
components and classify systems with the EMP and AIAG
methods?
Balanced design:
I Number of Operators: 3, 6, 9, 12
I Number of Parts: 5, 10, 15
I Number of Replications: 2, 3
Balanced design:
I Number of Operators: 3, 6, 9, 12
I Number of Parts: 5, 10, 15
I Number of Replications: 2, 3
Error variance breakdown:
I Operator variance = 0.45*σe2
I Operator*Part variance = 0.1*σe2
I Residual variance = 0.45*σe2
EMP Classifications
I All methods are correct about the same amount.
EMP Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most except for really bad
systems (class 4).
EMP Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most except for really bad
systems (class 4).
AIAG Classifications
I All methods are correct about the same amount.
EMP Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most except for really bad
systems (class 4).
AIAG Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most. Increasing operators
does not have much impact.
EMP Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most except for really bad
systems (class 4).
AIAG Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most. Increasing operators
does not have much impact.
Recommendation: Use more than 3 operators (especially for
EMP classifications) and at least 10 parts.
Balanced Design:
I Number of Operators: 3, 6, 9, 12, 15
I Number of Parts: 5, 10, 15, 20, 25
I Number of Replications: 2, 3
Balanced Design:
I Number of Operators: 3, 6, 9, 12, 15
I Number of Parts: 5, 10, 15, 20, 25
I Number of Replications: 2, 3
Error variance breakdown:
I Operator variance = 0.5*σe2
I Residual variance = 0.5*σe2
EMP Classifications
I All methods are correct about the same amount.
EMP Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most for good systems
(classes 1 and 2) and increasing operators helps the most with bad
systems (classes 3 and 4).
EMP Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most for good systems
(classes 1 and 2) and increasing operators helps the most with bad
systems (classes 3 and 4).
I Recommendation: Use more than 3 operators and at least 10
parts.
EMP Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most for good systems
(classes 1 and 2) and increasing operators helps the most with bad
systems (classes 3 and 4).
I Recommendation: Use more than 3 operators and at least 10
parts.
AIAG Classifications
I REML performs the best and is far superior for acceptable systems.
(Bayesian and Hybrid do well for marginal systems if you have
higher sample sizes but horribly for acceptable systems.)
EMP Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most for good systems
(classes 1 and 2) and increasing operators helps the most with bad
systems (classes 3 and 4).
I Recommendation: Use more than 3 operators and at least 10
parts.
AIAG Classifications
I REML performs the best and is far superior for acceptable systems.
(Bayesian and Hybrid do well for marginal systems if you have
higher sample sizes but horribly for acceptable systems.)
I Increasing number of parts helps the most. It has more impact for
marginal systems.
EMP Classifications
I All methods are correct about the same amount.
I Increasing number of parts helps the most for good systems
(classes 1 and 2) and increasing operators helps the most with bad
systems (classes 3 and 4).
I Recommendation: Use more than 3 operators and at least 10
parts.
AIAG Classifications
I REML performs the best and is far superior for acceptable systems.
(Bayesian and Hybrid do well for marginal systems if you have
higher sample sizes but horribly for acceptable systems.)
I Increasing number of parts helps the most. It has more impact for
marginal systems.
I Recommendation: Use REML, especially if you think your
system is acceptable! Sample sizes with more than 3
operators and at least 10 parts are best. Caution: REML was
still only correct 73.2% with 15 operators and 25 parts.
Fine tune the sample sizes between 3 and 6 operators and 5 and
10 parts.
Fine tune the sample sizes between 3 and 6 operators and 5 and
10 parts.
Study more types of MSA designs.
Fine tune the sample sizes between 3 and 6 operators and 5 and
10 parts.
Study more types of MSA designs.
Try different breakdowns of error variance.