Abstract
Control charts are widely used as a tool in process quality monitoring to detect anomalies and to improve the quality of a process and product. Nevertheless, their limitations have increased in the face of increasingly complex manufacturing processes. They do not have capability of handling large streams of non-normal and autocorrelated multivariate data, which is in most real applications. This may lead to an increase in false alarm signals and/or missed detection of anomalies. They are not designed to automatically identify the root causes of an anomaly when the process is out-of-control. Several machine-learning techniques were integrated with control charts to improve the sensitivity and specificity of anomaly detection. Nevertheless, some existing techniques still produce a high false alarm rate and/or missed detection. The root cause analysis is seldom performed. In this paper, we propose a new integration that combines the logical analysis of data regression technique (LADR) and the exponential weighted moving average (EWMA) as a new model-based control chart. LADR is based on the traditional LAD methodology, which is a supervised data mining technique for pattern generation. LADR transforms the original independent variables into pattern variables by using cbmLAD software to develop a regression model. The LADR–EWMA increases the sensitivity of anomaly detection in the process and uses the patterns to perform root cause analysis of that anomaly. We applied LADR–EWMA to a real application: a concrete manufacturing process. We compared its performance with Linear regression, Support vector regression, Partial Least Square regression, and Multivariate adaptive regression Spline. The results demonstrate that the LADR–EWMA, which is based on pattern recognition, performs better compared to the other techniques in terms of a reduction of false alarms and missed detection. In addition, LADR–EWMA facilitates interpretation and identification of the root cause of the detected anomaly.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.References
Ahsan, M., Mashuri, M., Kuswanto, H., Prastyo, D. D., et al. (2018). Intrusion detection system using multivariate control chart hotelling’s T2 based on PCA. International Journal on Advanced Science, Engineering and Information Technology, 8(5), 1905–1911.
Alcala, C. F., & Qin, S. J. (2009). Reconstruction-based contribution for process monitoring. Automatica, 45(7), 1593–1600.
Atashgar, K., & Noorossana, R. (2011). An integrating approach to root cause analysis of a bivariate mean vector with a linear trend disturbance. The International Journal of Advanced Manufacturing Technology, 52(1), 407–420.
Atienza, O. O., Tang, L. C., & Ang, B. W. (1998). Quality notes: Simultaneous monitoring of univariate and multivariate SPC information using boxplots. International Journal of Quality Science, 3(2), 194–204.
Bakdi, A., & Kouadri, A. (2017). A new adaptive PCA based thresholding scheme for fault detection in complex systems. Chemometrics and Intelligent Laboratory Systems, 162, 83–93.
Bhamare, D., & Suryawanshi, P. (2018). Review on reliable pattern recognition with machine learning techniques. Fuzzy Information and Engineering, 10(3), 362–377.
Blazek, L. W., Novic, B., & Scott, D. M. (1987). Displaying multivariate data using polyplots. Journal of Quality Technology, 19(2), 69–74.
Cheng, C. S., & Cheng, H. P. (2008). Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines. Expert Systems with Applications, 35(1–2), 198–206.
Chiarini, A. (2020). Industry 4.0, quality management and TQM world. A systematic literature review and a proposed agenda for further research. The TQM Journal, 32(4), 603–616.
Chua, M., & Montgomery, D. C. (1992). Investigation and characterization of a control scheme for multivariate quality control. Quality and Reliability Engineering International, 8(1), 37–44.
Connell, S. (2017). As industry 4.0 continues to evolve, what can quality professionals do to ensure they will be an integral asset throughout this industrial revolution? Quality in Mind.
Cuentas, S., Peñabaena-Niebles, R., & Garcia, E. (2017). Support vector machine in statistical process monitoring: A methodological and analytical review. The International Journal of Advanced Manufacturing Technology, 91(1), 485–500.
Diren, D. D., Boran, S., Selvi, I. H., & Hatipoglu, T. (2019). Root cause detection with an ensemble machine learning approach in the multivariate manufacturing process (pp. 163–174). Springer.
Dou, Y., & Sa, P. (2002). One-sided control charts for the mean of positively skewed distributions. Total Quality Management, 13(7), 1021–1033.
Du, S., Lv, J., & Xi, L. (2012). On-line classifying process mean shifts in multivariate control charts based on multiclass support vector machines. International Journal of Production Research, 50(22), 6288–6310.
Dua, D., & Graff, C. (2019). UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences. http://archive.ics.uci.edu/ml
Escobar, C. A., McGovern, M. E., & Morales-Menendez, R. (2021). Quality 4.0: A review of big data challenges in manufacturing. Journal of Intelligent Manufacturing, 32, 2319–2334.
Farokhnia, M., & Niaki, S. T. A. (2020). Principal component analysis-based control charts using support vector machines for multivariate non-normal distributions. Communications in Statistics-Simulation and Computation, 49(17), 1815–1838.
Friedman, J. H. (1991). Multivariate adaptive regression splines. The Annals of Statistics, 19, 1–67.
Fuchs, C., & Benjamini, Y. (1994). Multivariate profile charts for statistical process control. Technometrics, 36(2), 182–195.
Gani, W., Taleb, H., & Limam, M. (2010). Support vector regression based residual control charts. Journal of Applied Statistics, 37(2), 309–324.
Guh, R. S., & Shiue, Y. R. (2008). An effective application of decision tree learning for on-line detection of mean shifts in multivariate control charts. Computers & Industrial Engineering, 55(2), 475–493.
Haq, A., Gulzar, R., & Khoo, M. B. C. (2018). An efficient adaptive EWMA control chart for monitoring the process mean. Quality and Reliability Engineering International, 34(4), 563–571.
Harrou, F., Nounou, M. N., Nounou, H. N., & Madakyaru, M. (2015). PLS-based EWMA fault detection strategy for process monitoring. Journal of Loss Prevention in the Process Industries, 36, 108–119.
Hawkins, D. M. (1991). Multivariate quality control based on regression-adjusted variables. Technometrics, 33(1), 61–75.
He, Q. P., & Wang, J. (2007). Fault detection using the k-nearest neighbor rule for semiconductor manufacturing processes. IEEE Transactions on Semiconductor Manufacturing, 20(4), 345–354.
He, S., Wang, G. A., Zhang, M., & Cook, D. F. (2013). Multivariate process monitoring and fault identification using multiple decision tree classifiers. International Journal of Production Research, 51(11), 3355–3371.
Jacob, D. (2017). Quality 4.0 impact and strategy handbook: Getting digitally connected to transform quality management. LNS Research.
Jian, Z., Xia, B., Wang, C., & Li, Z. (2018). Diagnosis of out-of-control signals in multivariate manufacturing processes with random forests. In International workshop of advanced manufacturing and automation (pp. 262–267). Springer.
Jiang, W., Wang, K., & Tsung, F. (2012). A variable-selection-based multivariate EWMA chart for process monitoring and diagnosis. Journal of Quality Technology, 44(3), 209–230.
Khalifa, R.M., Yacout, S., & Bassetto, S. (2021a). Quality 4.0: Entity relationship model for inspection and repair processes in aerospace domain. In Proceedings of the international conference on industrial engineering and operations management, Monterrey, Mexico (November 3–5)
Khalifa, R. M., Yacout, S., & Bassetto, S. (2021b). Developing machine-learning regression model with logical analysis of data (LAD). Computers & Industrial Engineering, 151, 106947.
Kharbach, M., Cherrah, Y., Vander Heyden, Y., & Bouklouze, A. (2017). Multivariate statistical process control in product quality review assessment—A case study. Annales Pharmaceutiques Françaises, 75(6), 446–454.
Kim, J., Jeong, M. K., Elsayed, E. A., Al-Khalifa, K. N., & Hamouda, A. M. S. (2016). An adaptive step-down procedure for fault variable identification. International Journal of Production Research, 54(11), 3187–3200.
Kim, S. B., Jitpitaklert, W., Chen, V. C., Lee, J., & Park, S. K. (2013). Data mining model adjustment control charts for cascade processes. European Journal of Industrial Engineering, 7(4), 442–455.
Kim, S. B., Jitpitaklert, W., Park, S., & Hwang, S. J. (2012a). Data mining model-based control charts for multivariate and autocorrelated processes. Expert Systems with Applications, 39(2), 2073–2081.
Kim, S. B., Jitpitaklert, W., Park, S. K., & Hwang, S. J. (2012b). Data mining model-based control charts for multivariate and autocorrelated processes. Expert Systems with Applications, 39(2), 2073–2081.
Kuang, T. H., Yan, Z., & Yao, Y. (2015). Multivariate fault isolation via variable selection in discriminant analysis. Journal of Process Control, 35, 30–40.
Lucas, J. M., & Saccucci, M. S. (1990). Exponentially weighted moving average control schemes: Properties and enhancements. Technometrics, 32(1), 1–12.
Mandel, B. J. (1969). The regression control chart. Journal of Quality Technology, 1(1), 1–9.
Mason, R. L., Tracy, N. D., & Young, J. C. (1995). Decomposition of T2 for multivariate control chart interpretation. Journal of Quality Technology, 27(2), 99–108.
Mehta, P. K., & Monteiro, P. J. M. (2014). Concrete: Microstructure, properties, and materials. McGraw-Hill Education.
Mittal, M., Goyal, L. M., Hemanth, D. J., & Sethi, J. K. (2019). Clustering approaches for high-dimensional databases: A review. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 9(3), 1300.
Montgomery, D. C. (Ed.). (2020). Introduction to statistical quality control. Wiley.
Mortada, M. A., Yacout, S., & Lakis, A. (2014). Fault diagnosis in power transformers using multi-class logical analysis of data. Journal of Intelligent Manufacturing, 25(6), 1429–1439.
Murphy, B. J. (1987). Selecting out of control variables with the T2 multivariate quality control procedure. Journal of the Royal Statistical Society: Series D, 36(5), 571–581.
Niaki, S. T. A., & Abbasi, B. (2005). Fault diagnosis in multivariate control charts using artificial neural networks. Quality and Reliability Engineering International, 21(8), 825–840.
Pham, H. (2006). Springer handbook of engineering statistics. Springer.
Prabhu, S. S., & Runger, G. C. (1997). Designing a multivariate EWMA control chart. Journal of Quality Technology, 29(1), 8–15.
Qin, S. J. (2012). Survey on data-driven industrial process monitoring and diagnosis. Annual Reviews in Control, 36(2), 220–234.
Ragab, A., Yacout, S., & Ouali, M.S. (2015). Interpretable pattern-based machine learning for condition based maintenance. In Conference RAMS 2015, Florida, USA.
RStudio Team. (2020). RStudio: Integrated Development Environment for R, Inc. http://www.rstudio.com/
Ryoo, H. S., & Jang, I.-Y. (2009). MILP approach to pattern generation in logical analysis of data. Discrete Applied Mathematics, 157(4), 749–761.
Salehi, M., Bahreininejad, A., & Nakhai, I. (2011). On-line analysis of out-of-control signals in multivariate manufacturing processes using a hybrid learning-based model. Neurocomputing, 74(12–13), 2083–2095.
Steiner, S. H. (1999). EWMA control charts with time-varying control limits and fast initial response. Journal of Quality Technology, 31(1), 75–86.
Subramanyam, N., & Houshmand, A. A. (1995). Simultaneous representation of multivariate and corresponding univariate \(\bar{X}\) charts using line-graph. Quality Engineering, 7(4), 681–692.
Torgo, L., & Gama, J. (1997). Regression using classification algorithms. Intelligent Data Analysis, 1(4), 275–292.
Yacout, S., Salamanca, D., & Mortada, M.A. (2017). Tool and method for fault detection of devices by condition based maintenance. Google Patents. US Patent 9824060.
Yan, Z., & Yao, Y. (2015). Variable selection method for fault isolation using least absolute shrinkage and selection operator (lasso). Chemometrics and Intelligent Laboratory Systems, 146, 136–146.
Yeh, I. C. (2007). Modeling slump flow of concrete using second-order regressions and artificial neural networks. Cement and Concrete Composites, 29(6), 474–480.
Zhao, Y., Wang, S., & Xiao, F. (2013). A statistical fault detection and diagnosis method for centrifugal chillers based on exponentially-weighted moving average control charts and support vector regression. Applied Thermal Engineering, 51(1–2), 560–572.
Acknowledgements
This work was supported by the Natural Sciences and Engineering Research Council of Canada (NSERC) [Grant Numbers RGPIN-2017- 05785].
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Khalifa, R.M., Yacout, S. & Bassetto, S. Root cause analysis of an out-of-control process using a logical analysis of data regression model and exponential weighted moving average. J Intell Manuf 35, 1321–1336 (2024). https://doi.org/10.1007/s10845-023-02118-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-023-02118-z