Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Root cause analysis of an out-of-control process using a logical analysis of data regression model and exponential weighted moving average

Published: 05 April 2023 Publication History

Abstract

Control charts are widely used as a tool in process quality monitoring to detect anomalies and to improve the quality of a process and product. Nevertheless, their limitations have increased in the face of increasingly complex manufacturing processes. They do not have capability of handling large streams of non-normal and autocorrelated multivariate data, which is in most real applications. This may lead to an increase in false alarm signals and/or missed detection of anomalies. They are not designed to automatically identify the root causes of an anomaly when the process is out-of-control. Several machine-learning techniques were integrated with control charts to improve the sensitivity and specificity of anomaly detection. Nevertheless, some existing techniques still produce a high false alarm rate and/or missed detection. The root cause analysis is seldom performed. In this paper, we propose a new integration that combines the logical analysis of data regression technique (LADR) and the exponential weighted moving average (EWMA) as a new model-based control chart. LADR is based on the traditional LAD methodology, which is a supervised data mining technique for pattern generation. LADR transforms the original independent variables into pattern variables by using cbmLAD software to develop a regression model. The LADR–EWMA increases the sensitivity of anomaly detection in the process and uses the patterns to perform root cause analysis of that anomaly. We applied LADR–EWMA to a real application: a concrete manufacturing process. We compared its performance with Linear regression, Support vector regression, Partial Least Square regression, and Multivariate adaptive regression Spline. The results demonstrate that the LADR–EWMA, which is based on pattern recognition, performs better compared to the other techniques in terms of a reduction of false alarms and missed detection. In addition, LADR–EWMA facilitates interpretation and identification of the root cause of the detected anomaly.

References

[1]
Ahsan M, Mashuri M, Kuswanto H, Prastyo DD, et al. Intrusion detection system using multivariate control chart hotelling’s T2 based on PCA International Journal on Advanced Science, Engineering and Information Technology 2018 8 5 1905-1911
[2]
Alcala CF and Qin SJ Reconstruction-based contribution for process monitoring Automatica 2009 45 7 1593-1600
[3]
Atashgar K and Noorossana R An integrating approach to root cause analysis of a bivariate mean vector with a linear trend disturbance The International Journal of Advanced Manufacturing Technology 2011 52 1 407-420
[4]
Atienza OO, Tang LC, and Ang BW Quality notes: Simultaneous monitoring of univariate and multivariate SPC information using boxplots International Journal of Quality Science 1998 3 2 194-204
[5]
Bakdi A and Kouadri A A new adaptive PCA based thresholding scheme for fault detection in complex systems Chemometrics and Intelligent Laboratory Systems 2017 162 83-93
[6]
Bhamare D and Suryawanshi P Review on reliable pattern recognition with machine learning techniques Fuzzy Information and Engineering 2018 10 3 362-377
[7]
Blazek LW, Novic B, and Scott DM Displaying multivariate data using polyplots Journal of Quality Technology 1987 19 2 69-74
[8]
Cheng CS and Cheng HP Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines Expert Systems with Applications 2008 35 1–2 198-206
[9]
Chiarini A Industry 4.0, quality management and TQM world. A systematic literature review and a proposed agenda for further research The TQM Journal 2020 32 4 603-616
[10]
Chua M and Montgomery DC Investigation and characterization of a control scheme for multivariate quality control Quality and Reliability Engineering International 1992 8 1 37-44
[11]
Connell, S. (2017). As industry 4.0 continues to evolve, what can quality professionals do to ensure they will be an integral asset throughout this industrial revolution? Quality in Mind.
[12]
Cuentas S, Peñabaena-Niebles R, and Garcia E Support vector machine in statistical process monitoring: A methodological and analytical review The International Journal of Advanced Manufacturing Technology 2017 91 1 485-500
[13]
Diren, D. D., Boran, S., Selvi, I. H., & Hatipoglu, T. (2019). Root cause detection with an ensemble machine learning approach in the multivariate manufacturing process (pp. 163–174). Springer.
[14]
Dou Y and Sa P One-sided control charts for the mean of positively skewed distributions Total Quality Management 2002 13 7 1021-1033
[15]
Du S, Lv J, and Xi L On-line classifying process mean shifts in multivariate control charts based on multiclass support vector machines International Journal of Production Research 2012 50 22 6288-6310
[16]
Dua, D., & Graff, C. (2019). UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences. http://archive.ics.uci.edu/ml
[17]
Escobar CA, McGovern ME, and Morales-Menendez R Quality 4.0: A review of big data challenges in manufacturing Journal of Intelligent Manufacturing 2021 32 2319-2334
[18]
Farokhnia M and Niaki STA Principal component analysis-based control charts using support vector machines for multivariate non-normal distributions Communications in Statistics-Simulation and Computation 2020 49 17 1815-1838
[19]
Friedman JH Multivariate adaptive regression splines The Annals of Statistics 1991 19 1-67
[20]
Fuchs C and Benjamini Y Multivariate profile charts for statistical process control Technometrics 1994 36 2 182-195
[21]
Gani W, Taleb H, and Limam M Support vector regression based residual control charts Journal of Applied Statistics 2010 37 2 309-324
[22]
Guh RS and Shiue YR An effective application of decision tree learning for on-line detection of mean shifts in multivariate control charts Computers & Industrial Engineering 2008 55 2 475-493
[23]
Haq A, Gulzar R, and Khoo MBC An efficient adaptive EWMA control chart for monitoring the process mean Quality and Reliability Engineering International 2018 34 4 563-571
[24]
Harrou F, Nounou MN, Nounou HN, and Madakyaru M PLS-based EWMA fault detection strategy for process monitoring Journal of Loss Prevention in the Process Industries 2015 36 108-119
[25]
Hawkins DM Multivariate quality control based on regression-adjusted variables Technometrics 1991 33 1 61-75
[26]
He QP and Wang J Fault detection using the k-nearest neighbor rule for semiconductor manufacturing processes IEEE Transactions on Semiconductor Manufacturing 2007 20 4 345-354
[27]
He S, Wang GA, Zhang M, and Cook DF Multivariate process monitoring and fault identification using multiple decision tree classifiers International Journal of Production Research 2013 51 11 3355-3371
[28]
Jacob, D. (2017). Quality 4.0 impact and strategy handbook: Getting digitally connected to transform quality management. LNS Research.
[29]
Jian, Z., Xia, B., Wang, C., & Li, Z. (2018). Diagnosis of out-of-control signals in multivariate manufacturing processes with random forests. In International workshop of advanced manufacturing and automation (pp. 262–267). Springer.
[30]
Jiang W, Wang K, and Tsung F A variable-selection-based multivariate EWMA chart for process monitoring and diagnosis Journal of Quality Technology 2012 44 3 209-230
[31]
Khalifa, R.M., Yacout, S., & Bassetto, S. (2021a). Quality 4.0: Entity relationship model for inspection and repair processes in aerospace domain. In Proceedings of the international conference on industrial engineering and operations management, Monterrey, Mexico (November 3–5)
[32]
Khalifa, R. M., Yacout, S., & Bassetto, S. (2021b). Developing machine-learning regression model with logical analysis of data (LAD). Computers & Industrial Engineering,151, 106947.
[33]
Kharbach, M., Cherrah, Y., Vander Heyden, Y., & Bouklouze, A. (2017). Multivariate statistical process control in product quality review assessment—A case study. Annales Pharmaceutiques Françaises,75(6), 446–454.
[34]
Kim J, Jeong MK, Elsayed EA, Al-Khalifa KN, and Hamouda AMS An adaptive step-down procedure for fault variable identification International Journal of Production Research 2016 54 11 3187-3200
[35]
Kim SB, Jitpitaklert W, Chen VC, Lee J, and Park SK Data mining model adjustment control charts for cascade processes European Journal of Industrial Engineering 2013 7 4 442-455
[36]
Kim, S. B., Jitpitaklert, W., Park, S., & Hwang, S. J. (2012a). Data mining model-based control charts for multivariate and autocorrelated processes. Expert Systems with Applications,39(2), 2073–2081.
[37]
Kim, S. B., Jitpitaklert, W., Park, S. K., & Hwang, S. J. (2012b). Data mining model-based control charts for multivariate and autocorrelated processes. Expert Systems with Applications,39(2), 2073–2081.
[38]
Kuang TH, Yan Z, and Yao Y Multivariate fault isolation via variable selection in discriminant analysis Journal of Process Control 2015 35 30-40
[39]
Lucas JM and Saccucci MS Exponentially weighted moving average control schemes: Properties and enhancements Technometrics 1990 32 1 1-12
[40]
Mandel BJ The regression control chart Journal of Quality Technology 1969 1 1 1-9
[41]
Mason RL, Tracy ND, and Young JC Decomposition of T2 for multivariate control chart interpretation Journal of Quality Technology 1995 27 2 99-108
[42]
Mehta PK and Monteiro PJM Concrete: Microstructure, properties, and materials 2014 McGraw-Hill Education
[43]
Mittal M, Goyal LM, Hemanth DJ, and Sethi JK Clustering approaches for high-dimensional databases: A review Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 2019 9 3 1300
[44]
Montgomery DC Introduction to statistical quality control 2020 Wiley
[45]
Mortada MA, Yacout S, and Lakis A Fault diagnosis in power transformers using multi-class logical analysis of data Journal of Intelligent Manufacturing 2014 25 6 1429-1439
[46]
Murphy, B. J. (1987). Selecting out of control variables with the T2 multivariate quality control procedure. Journal of the Royal Statistical Society: Series D,36(5), 571–581.
[47]
Niaki STA and Abbasi B Fault diagnosis in multivariate control charts using artificial neural networks Quality and Reliability Engineering International 2005 21 8 825-840
[48]
Pham H Springer handbook of engineering statistics 2006 Springer
[49]
Prabhu SS and Runger GC Designing a multivariate EWMA control chart Journal of Quality Technology 1997 29 1 8-15
[50]
Qin SJ Survey on data-driven industrial process monitoring and diagnosis Annual Reviews in Control 2012 36 2 220-234
[51]
Ragab, A., Yacout, S., & Ouali, M.S. (2015). Interpretable pattern-based machine learning for condition based maintenance. In Conference RAMS 2015, Florida, USA.
[52]
RStudio Team. (2020). RStudio: Integrated Development Environment for R, Inc. http://www.rstudio.com/
[53]
Ryoo HS and Jang I-Y MILP approach to pattern generation in logical analysis of data Discrete Applied Mathematics 2009 157 4 749-761
[54]
Salehi M, Bahreininejad A, and Nakhai I On-line analysis of out-of-control signals in multivariate manufacturing processes using a hybrid learning-based model Neurocomputing 2011 74 12–13 2083-2095
[55]
Steiner SH EWMA control charts with time-varying control limits and fast initial response Journal of Quality Technology 1999 31 1 75-86
[56]
Subramanyam N and Houshmand AA Simultaneous representation of multivariate and corresponding univariate X¯ charts using line-graph Quality Engineering 1995 7 4 681-692
[57]
Torgo L and Gama J Regression using classification algorithms Intelligent Data Analysis 1997 1 4 275-292
[58]
Yacout, S., Salamanca, D., & Mortada, M.A. (2017). Tool and method for fault detection of devices by condition based maintenance. Google Patents. US Patent 9824060.
[59]
Yan Z and Yao Y Variable selection method for fault isolation using least absolute shrinkage and selection operator (lasso) Chemometrics and Intelligent Laboratory Systems 2015 146 136-146
[60]
Yeh IC Modeling slump flow of concrete using second-order regressions and artificial neural networks Cement and Concrete Composites 2007 29 6 474-480
[61]
Zhao Y, Wang S, and Xiao F A statistical fault detection and diagnosis method for centrifugal chillers based on exponentially-weighted moving average control charts and support vector regression Applied Thermal Engineering 2013 51 1–2 560-572

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Journal of Intelligent Manufacturing
Journal of Intelligent Manufacturing  Volume 35, Issue 3
Mar 2024
458 pages

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 05 April 2023
Accepted: 17 March 2023
Received: 21 February 2022

Author Tags

  1. Process monitoring
  2. Logical analysis of data regression (LADR)
  3. Anomaly detection
  4. Root cause analysis
  5. LADR based EWMA control chart (LADR–EWMA)
  6. Quality 4.0

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Jan 2025

Other Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media