Hybrid modeling of hetero-agglomeration processes: a framework for model selection and arrangement
Pages 583 - 604
Abstract
Modeling of hetero-agglomeration processes is invaluable for a variety of applications in particle technology. Traditionally, population balance equations (PBE) are employed; however, calculation of kinetic rates is challenging due to heterogeneous surface properties and insufficient material data. This study investigates how the integration of machine learning (ML) techniques—resulting in so-called hybrid models (HM)—can help to integrate experimental data and close this gap. A variety of ML algorithms can either be used to estimate kinetic rates for the PBE (serial HM) or to correct the PBE’s output (parallel HM). As the optimal choice of the HM architecture is highly problem-dependent, we propose a general and objective framework for model selection and arrangement. A repeated nested cross-validation with integrated hyper-parameter optimization ensures a fair and meaningful comparison between different HMs. This framework was subsequently applied to experimental data of magnetic seeded filtration, where prediction errors of the pure PBE were reduced by applying the hybrid modeling approach. The framework helped to identify that for the given data set, serial outperforms parallel arrangement and that more advanced ML algorithms provide better interpolation ability. Additionally, it enables to draw inferences to general properties of the underlying PBE model and a statistical investigation of hyper-parameter optimization that paves the way for further improvements.
References
[1]
Azevedo C, Lee R, Portela RMC, et al. Hybrid ann-mechanistic models for general chemical and biochemical processes 2017 Hauppauge Nova Science Publishers 229-256
[2]
Bayer B, von Stosch M, Striedner G, et al. Comparison of modeling methods for doe-based holistic upstream process characterization Biotechnol J 2020 15 5 1900,551
[3]
Bergstra J, Bengio Y (2012) Random search for hyper-parameter optimization. J Mach Learn Res 13(2)
[4]
Bergström L Hamaker constants of inorganic materials Adv Colloid Interface Sci 1997 70 125-169
[5]
Beykal B, Boukouvala F, Floudas CA, et al. Global optimization of grey-box computational systems using surrogate functions and application to highly constrained oil-field operations Comput Chem Eng 2018 114 99-110
[6]
Bhutani N, Rangaiah GP, and Ray AK First-principles, data-based, and hybrid modeling and optimization of an industrial hydrocracking unit Ind Eng Chem Res 2006 45 23 7807-7816
[7]
Bollas GM, Papadokonstadakis S, Michalopoulos J, et al. Using hybrid neural networks in scaling up an fcc model from a pilot plant to an industrial unit Chem Eng Process Process Intens 2003 42 8 697-713
[8]
Brochu E, Cora VM, de Freitas N (2010) A tutorial on bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning.
[9]
Byrd RH, Lu P, Nocedal J, et al. A limited memory algorithm for bound constrained optimization SIAM J Sci Comput 1995 16 5 1190-1208
[10]
Cawley GC and Talbot NL On over-fitting in model selection and subsequent selection bias in performance evaluation J Mach Learn Res 2010 11 2079-2107
[11]
Chen Y and Ierapetritou M A framework of hybrid model development with identification of plant-model mismatch AIChE J 2020 66 10
[12]
Chin CJ, Yiacoumi S, and Tsouris C Shear-induced flocculation of colloidal particles in stirred tanks J Colloid Interface Sci 1998 206 2 532-545
[13]
Conlin J, Peel C, and Montague GA Modelling pressure drop in water treatment Artif Intell Eng 1997 11 4 393-400
[14]
Corazza F, Calsavara L, Moraes F, et al. Determination of inhibition in the enzymatic hydrolysis of cellobiose using hybrid neural modeling Braz J Chem Eng 2005 22 1 19-29
[15]
Dosta M and Chan TT Linking process-property relationships for multicomponent agglomerates using dem-ann-pbm coupling Powder Technol 2022 398 117 156
[16]
Elimelech M (1998) Particle deposition and aggregation : measurement, modelling and simulation, 1st edn. Colloid and surface engineering series. Butterworth-Heinemann, Woburn.
[17]
Endres SC, Sandrock C, and Focke WW A simplicial homology algorithm for lipschitz optimisation J Global Optim 2018 72 2 181-217
[18]
Filzmoser P, Liebmann B, and Varmuza K Repeated double cross validation J Chemom 2009 23 4 160-171
[19]
Frungieri G and Vanni M Aggregation and breakup of colloidal particle aggregates in shear flow: a combined monte Carlo-Stokesian dynamics approach Powder Technol 2021 388 357-370
[20]
Fuchs N Über die stabilität und aufladung der aerosole Z Phys 1934 89 11 736-743
[21]
Georgieva P, Meireles MJ, and Feyo de Azevedo S Knowledge-based hybrid modelling of a batch crystallisation when accounting for nucleation, growth and agglomeration phenomena Chem Eng Sci 2003 58 16 3699-3713
[22]
Ghosh D, Moreira J, and Mhaskar P Model predictive control embedding a parallel hybrid modeling strategy Ind Eng Chem Res 2021 60 6 2547-2562
[23]
Gregory J Interaction of unequal double layers at constant charge J Colloid Interface Sci 1975 51 1 44-51
[24]
Guo R and Liu H A hybrid mechanism- and data-driven soft sensor based on the generative adversarial network and gated recurrent unit IEEE Sens J 2021 21 22 25,901-25,911
[25]
Hamaker HC The London-van der Waals attraction between spherical particles Physica 1937 4 10 1058-1072
[26]
Honig EP, Roebersen GJ, and Wiersema PH Effect of hydrodynamic interaction on the coagulation rate of hydrophobic colloids J Colloid Interface Sci 1971 36 1 97-109
[27]
Hornik K, Stinchcombe M, and White H Multilayer feedforward networks are universal approximators Neural Netw 1989 2 5 359-366
[28]
Hutter F, Hoos HH, Leyton-Brown K (2011) Sequential model-based optimization for general algorithm configuration. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6683 LNCS, pp 507–523.
[29]
Hutter F, Kotthoff L, and Vanschoren J Automated machine learning: methods, systems, challenges 2019 Berlin Springer Nature
[30]
James G, Witten D, Hastie T, et al. An introduction to statistical learning 2013 Berlin Springer
[31]
Jan Hagendorfer E (2021) Knowledge incorporation for machine learning in condition monitoring: A survey. In: 2021 International symposium on electrical, electronics and information engineering. Association for Computing Machinery, New York, NY, USA, ISEEIE 2021, pp 230–240.
[32]
Jeldres RI, Fawell PD, and Florio BJ Population balance modelling to describe the particle aggregation process: a review Powder Technol 2018 326 190-207
[33]
Kahrs O and Marquardt W Incremental identification of hybrid process models Comput Chem Eng 2008 32 4 694-705
[34]
Kim BJ, Kim IK, et al. Liew KM, Shen H, See S, et al. An application of hybrid least squares support vector machine to environmental process modeling Parallel and distributed computing: applications and technologies 2004 Berlin Springer 184-187
[35]
Krippl M, Dürauer A, and Duerkop M Hybrid modeling of cross-flow filtration: Predicting the flux evolution and duration of ultrafiltration processes Sep Purif Technol 2020 248 117 064
[36]
Krstajic D, Buturovic LJ, Leahy DE, et al. Cross-validation pitfalls when selecting and assessing regression and classification models J Cheminform 2014 6 1 1-15
[37]
Kumar J, Peglow M, Warnecke G, et al. Improved accuracy and convergence of discretized population balance for aggregation: the cell average technique Chem Eng Sci 2006 61 10 3327-3342
[38]
Kumar J, Peglow M, Warnecke G, et al. The cell average technique for solving multi-dimensional aggregation population balance equations Comput Chem Eng 2008 32 8 1810-1830
[39]
Lauret P, Boyer H, and Gatina JC Hybrid modelling of a sugar boiling process Control Eng Pract 2000 8 3 299-310
[40]
Lee DS, Jeon CO, Park JM, et al. Hybrid neural network modeling of a full-scale industrial wastewater treatment process Biotechnol Bioeng 2002 78 6 670-682
[41]
Lee DS, Vanrolleghem PA, and Park JM Parallel hybrid modeling methods for a full-scale cokes wastewater treatment plant J Biotechnol 2005 115 3 317-328
[42]
Lin S and Wiesner MR Deposition of aggregated nanoparticles—a theoretical and experimental study on the effect of aggregation state on the affinity between nanoparticles and a collector surface Environ Sci Technol 2012 46 24 13,270-13,277
[43]
Mädler J, Richter B, Wolz DSJ, et al. Hybride semi-parametrische modellierung der thermooxidativen stabilisierung von pan-precursorfasern Chem Ing Tec 2022
[44]
Mayer JK, Almar L, Asylbekov E, et al. Influence of the carbon black dispersing process on the microstructure and performance of li-ion battery cathodes Energ Technol 2020 8 2 1900,161
[45]
McBride K, Sanchez Medina EI, and Sundmacher K Hybrid semi-parametric modeling in separation processes: a review Chem Ing Tec 2020 92 7 842-855
[46]
Menesklou P, Sinn T, Nirschl H, et al. Grey box modelling of decanter centrifuges by coupling a numerical process model with a neural network Minerals 2021 11 7 755
[47]
Menesklou P, Sinn T, Nirschl H, et al. Scale-up of decanter centrifuges for the particle separation and mechanical dewatering in the minerals processing industry by means of a numerical process model Minerals 2021
[48]
Meng Y, Lan Q, Qin J, et al. Data-driven soft sensor modeling based on twin support vector regression for cane sugar crystallization J Food Eng 2019 241 159-165
[49]
Mowbray M, Savage T, Wu C, et al. Machine learning for biochemical engineering: a review Biochem Eng J 2021 172 108 054
[50]
Nazemzadeh N, Malanca AA, Nielsen RF, et al. Integration of first-principle models and machine learning in a modeling framework: an application to flocculation Chem Eng Sci 2021 245 116 864
[51]
Nielsen RF, Nazemzadeh N, Sillesen LW, et al. Hybrid machine learning assisted modelling framework for particle processes Comput Chem Eng 2020 140 106 916
[52]
Oliveira R Combining first principles modelling and artificial neural networks: a general framework Comput Chem Eng 2004 28 5 755-766
[53]
Pedregosa F, Varoquaux G, Gramfort A, et al. Scikit-learn: machine learning in Python J Mach Learn Res 2011 12 2825-2830
[54]
Pedrozo HA, Rodriguez Reartes SB, Chen Q, et al. Surrogate-model based milp for the optimal design of ethylene production from shale gas Comput Chem Eng 2020 141 107 015
[55]
Praetorius A, Badetti E, Brunelli A, et al. Strategies for determining heteroaggregation attachment efficiencies of engineered nanoparticles in aquatic environments Environ Sci Nano 2020 7 2 351-367
[56]
Psichogios DC and Ungar LH A hybrid neural network-first principles approach to process modeling AIChE J 1992 38 10 1499-1511
[57]
Ramkrishna D Population balances : theory and applications to particulate systems in engineering 2000 San Diego Academic Press
[58]
Rato TJ, Delgado P, Martins C, et al. First principles statistical process monitoring of high-dimensional industrial microelectronics assembly processes Processes 2020 8 11 1520
[59]
Reinhold A and Briesen H Numerical behavior of a multiscale aggregation model-coupling population balances and discrete element models Chem Eng Sci 2012 70 165-175
[60]
Rendall R and Reis MS Which regression method to use? making informed decisions in data-rich/knowledge poor scenarios—the predictive analytics comparison framework (pac) Chemom Intell Lab Syst 2018 181 52-63
[61]
Rhein F, Ruß F, and Nirschl H Collision case model for population balance equations in agglomerating heterogeneous colloidal systems: theory and experiment Colloids Surf A 2019 572 67-78
[62]
Rhein F, Scholl F, and Nirschl H Magnetic seeded filtration for the separation of fine polymer particles from dilute suspensions: microplastics Chem Eng Sci 2019 207 1278-1287
[63]
Rhein F, Schmid E, Esquivel FB, et al. Opportunities and challenges of magnetic seeded filtration in multidimensional fractionation Chem Ing Tec 2020 92 3 266-274
[64]
Rhein F, Kaiser S, Rhein M, et al. Agglomerate processing and recycling options in magnetic seeded filtration Chem Eng Sci 2021 238 116 577
[65]
Sansana J, Joswiak MN, Castillo I, et al. Recent trends on hybrid modeling for industry 4.0 Comput Chem Eng 2021 151 107,365
[66]
Santos JEW, Trierweiler JO, and Farenzena M Model update based on transient measurements for model predictive control and hybrid real-time optimization Ind Eng Chem Res 2021 60 7 3056-3065
[67]
Schubert J, Simutis R, Dors M, et al. Bioprocess optimization and control: application of hybrid modelling J Biotechnol 1994 35 1 51-68
[68]
Selomulya C, Bushell G, Amal R, et al. Understanding the role of restructuring in flocculation: the application of a population balance model Chem Eng Sci 2003 58 2 327-338
[69]
Shahriari B, Swersky K, Wang Z, et al. Taking the human out of the loop: a review of Bayesian optimization Proc IEEE 2016 104 1 148-175
[70]
Shaikhina T and Khovanova NA Handling limited datasets with neural networks in medical applications: a small-data approach Artif Intell Med 2017 75 51-63
[71]
Shaikhina T, Lowe D, Daga S, et al. Machine learning for predictive modelling based on small data in biomedical engineering IFAC-PapersOnLine 2015 28 20 469-474
[72]
Sharma N and Liu YA A hybrid science-guided machine learning approach for modeling chemical processes: a review AIChE J 2022
[73]
Simon LL, Fischer U, and Hungerbühler K Modeling of a three-phase industrial batch reactor using a hybrid first-principles neural-network model Ind Eng Chem Res 2006 45 21 7336-7343
[74]
Smola AJ and Schölkopf B A tutorial on support vector regression Stat Comput 2004 14 3 199-222
[75]
Stone M Cross-validatory choice and assessment of statistical predictions J R Stat Soc Ser B (Methodol) 1974 36 2 111-133
[76]
Taboada-Serrano P, Chin CJ, Yiacoumi S, et al. Modeling aggregation of colloidal particles Curr Opin Colloid Interface Sci 2005 10 3 123-132
[77]
Tholudur A and Ramirez WF Optimization of fed-batch bioreactors using neural network parameter function models Biotechnol Prog 1996 12 3 302-309
[78]
Thompson ML and Kramer MA Modeling chemical processes using prior knowledge and neural networks AIChE J 1994 40 8 1328-1340
[79]
Thon C, Finke B, Kwade A, et al. Artificial intelligence in process engineering Adv Intell Syst 2021 3 6 2000,261
[80]
Vabalas A, Gowen E, Poliakoff E, et al. Machine learning algorithm validation with a limited sample size PLoS ONE 2019 14 11 1-20
[81]
Valmacco V, Elzbieciak-Wodka M, Besnard C, et al. Dispersion forces acting between silica particles across water: influence of nanoscale roughness Nanoscale Horiz 2016 1 4 325-330
[82]
Van Can HJL, Hellinga C, Luyben KCAM, et al. Strategy for dynamic process modeling based on neural networks in macroscopic balances AIChE J 1996 42 12 3403-3418
[83]
Van Can HJL, Te Braake HAB, Dubbelman S, et al. Understanding and applying the extrapolation properties of serial gray-box models AIChE J 1998 44 5 1071-1089
[84]
Vapnik VN The nature of statistical learning theory 2000 2 New York Springer
[85]
Varma S and Simon R Bias in error estimation when using cross-validation for model selection BMC Bioinform 2006 7 1-8
[86]
Venkatasubramanian V The promise of artificial intelligence in chemical engineering: is it here, finally? AIChE J 2019 65 2 466-478
[87]
von Stosch M, Oliveira R, Peres J, et al. Hybrid semi-parametric modeling in process systems engineering: past, present and future Comput Chem Eng 2014 60 86-101
[88]
Wales DJ and Doye JPK Global optimization by basin-hopping and the lowest energy structures of Lennard-Jones clusters containing up to 110 atoms J Phys Chem A 1997 101 28 5111-5116
[89]
Wang X, Chen J, Liu C, et al. Hybrid modeling of penicillin fermentation process based on least square support vector machine Chem Eng Res Des 2010 88 4 415-420
[90]
Winkler M, Gleiss M, and Nirschl H Soft sensor development for real-time process monitoring of multidimensional fractionation in tubular centrifuges Nanomaterials 2021
[91]
Wu Z, Rincon D, and Christofides PD Process structure-based recurrent neural network modeling for model predictive control of nonlinear processes J Process Control 2020 89 74-84
[92]
Yang L and Shami A On hyperparameter optimization of machine learning algorithms: theory and practice Neurocomputing 2020 415 295-316 arXiv:2007.15745
[93]
Zendehboudi S, Rezaei N, and Lohi A Applications of hybrid models in chemical, petroleum, and energy systems: a systematic review Appl Energy 2018 228 2539-2566
[94]
Zhao L and You F A data-driven approach for industrial utility systems optimization under uncertainty Energy 2019 182 559-569
Index Terms
- Hybrid modeling of hetero-agglomeration processes: a framework for model selection and arrangement
Index terms have been assigned to the content through auto-classification.
Recommendations
Hybrid modeling of test-and-fix processes in incremental development
ICSP'08: Proceedings of the Software process, 2008 international conference on Making globally distributed software development a success storySoftware process simulation modeling has become an increasinglyactive research area for managing and improving software development processessince its introduction in the last two decades. Hybrid process simulationmodels have attracted interest as a ...
Neural Net Based Hybrid Modeling of the Methanol Synthesis Process
A Hybrid modeling approach, combining an analytical model with a radial basis function neural network is introduced in this paper. The modeling procedure is combined with genetic algorithm based feature selection designed to select informative variables ...
Refinement of system-level designs using hybrid modeling
ICECCS '95: Proceedings of the 1st International Conference on Engineering of Complex Computer SystemsThe design of complex systems requires an enormous amount of modeling and simulation at the various levels of detail to assure high quality results. Most design methodologies require the use of separate modeling languages and simulation environments for ...
Comments
Information & Contributors
Information
Published In
© The Author(s) 2023.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 01 April 2023
Accepted: 14 March 2023
Received: 14 September 2022
Author Tags
Qualifiers
- Research-article
Funding Sources
- Deutsche Forschungsgemeinschaft
- Karlsruher Institut für Technologie (KIT) (4220)
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 09 Aug 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in