Abstract
This paper considers the automated learning of strategies for real-time scheduling in dynamic factory floor environments. A simulation model of the shop floor provides continuous inputs to a genetic algorithm based learning system. Learning is used to update the knowledge bases of "intelligent" dispatchers in the floor shop setup. The performance of the learning system is compared with that of commonly used dispatching rules, and experimental results are presented for a two-stage flowline and for a more general jobshop environment.
Similar content being viewed by others
References
H. Aytug, S. Bhattacharyya, G.J. Koehler and J.L. Snowdon, A decision support framework for dynamic scheduling, Working Paper, 1995.
H. Aytug, S. Bhattacharyya, G.J. Koehler and J.L. Snowdon, A review of machine learning in scheduling, IEEE Transactions on Engineering Management 41(1994)165 - 171.
H. Aytug, G.J. Koehler and J.L. Snowdon, Genetic learning of dynamic scheduling within a simulation environment, Computers and Operations Research 21(1994)909 - 925.
P. Alpar and K.N. Srikanth, A comparison of analytic and knowledge-based approaches to closedshop scheduling, Annals of Operations Research 17(1989)347 -362.
K.R. Baker and J.W.M. Bertrand, A dynamic priority rule for scheduling against due dates, Journal of Operations Management 3(1982)37 - 42.
G. Bel, E. Bensana, D. Dubois, J. Erschier and P. Esquirol, A knowledge-based approach to industrial job-shop scheduling, in: Knowledge-Based Systems in Manufacturing A. Kusiak, ed., Taylor and Francis, 1989, pp. 207 - 246.
K. Bhaskaran and M. Pinedo, Dispatching, in: Handbook of Industrial Engineering G. Salvendy, ed., Wiley, New York, 1992.
J.A. Blessing and B.A. Watford, INFMSS, an intelligent FMS scheduling system, World Productivity Forum and 1987 Annual International Industrial Engineering Conference Proceedings 1987, pp. 82 - 88.
G. Buxey, Production scheduling: Theory and practice, European Journal of Operational Research 39(1989)17- 31.
G. Chryssolouris, K. Wright, J. Pierce and W. Cobb, Manufacturing systems operation: Dispatch rules versus intelligent control, Robotics and Computer-Integrated Manufacturing 4(1988)531-544.
L. Davis, Job shop schedulung with genetic algorithms, Proceedings of the 1st International Conference on Genetic Algorithms and their Applications Carnegie Mellon University, J.J. Grefenstette, ed., Morgan Kaufmann, 1985, pp. 136 - 140.
M.A.H. Dempster, A stochastic approach to hierarchical planning and scheduling, Proceedings of the NATO Advanced Study and Research Institute on Theoretical Approaches to Scheduling Problems Durham, UK, M.A.H. Dempster, J.K. Lenstra and A.G.H. Rinnooy Kan, eds., 1981, pp. 271 - 296.
M.S. Fox, Constraint-guided scheduling - a short history of research at CMU, Computers in Industry 14(1990)79 - 88.
M.S. Fox and S.F. Smith, The role of intelligent reactive processing in production management, Proceedings of CAM-I's 13th Annual Meeting and Technical Conference Clearwater Beach, FL, 1984, pp. 6.13 - 6.17.
F.G. Fu and Y.C. Ho, Using perturbation analysis for gradient estimation, averaging and updating in a stochastic approximation algorithm, Proceedings of the 1988 Winter Simulation Conference M. Abrams, P. Haigh and J. Comfort, eds., 1988, pp. 509 - 517.
D.E. Goldberg, Genetic Algorithms Addison-Wesley, MA, 1989.
D.E. Goldberg, B. Korb and K. Deb, Messy genetic algorithms: Motivation, analysis, and first results, Complex Systems 3(1989)493 - 530.
S.C. Graves, A review of production scheduling, Operations Research 29(1981)646 - 675.
J.J. Grefenstette, Incremental learning of control strategies with genetic algorithms, Proccedings of the 6th International Conference on Machine Learning Cornell University, A.M. Segré, ed., Morgan Kaufmann, 1989, pp. 340 - 344.
D. Haussler, Quantifying inductive bias: AI learning algorithms and Valiant's learning framework, Artificial Intelligence 36(1988)177 - 221.
L.C. Hershauer and R.J. Ebert, Search and simulation selection of a job-shop sequencing rule, Management Science 21(1975)833 - 843.
M.R. Hilliard, G.E. Liepins, G. Rangarajan and M. Palmer, Learning decision rules for scheduling problems: A classifier hybrid approach, Proceedings of the 6th International Workshop on Machine Learning A.M. Segré, ed., Cornell University, Ithaca, NY, 1989, pp. 188 - 190.
M.R. Hilliard, G.E. Liepins and M. Palmer, Machine learning applications to job shop scheduling, Proceedings of the 1st International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems University of Tennessee Space Institute, ACM Press, 1988.
M.R. Hilliard, G.E. Liepins, M. Palmer, M. Morrow and J. Richardson, A Classifier-based system for discovering scheduling heuristics, Genetic Algorithms and their Applications: Proceedings of the 2nd International Conference on Genetic Algorithms J.J. Grefenstette, ed., 1987, pp. 231 - 235.
Y.C. Ho, M.A. Eyler and T.T. Chien, A gradient technique for general buffer storage design in a production line, International Journal of Production Research 17(1979)557 - 580.
R.M. Kerr and R.V. Ebsary, Implementation of an expert system for production scheduling, European Journal of Operational Research 33(1988)17 - 29.
A.I. Khuri and J.A. Cornell, Response Surfaces: Design and Analysis Decker, New York, 1987.
G.J. Koehler, C. Lee, J. Snowdon, H. Aytug, J. Herrmann, F. Krämer, R. Major and R. Norris, Research and analysis of machine learning for dynamic scheduling, Technical Report, IBM Corporation, Boca Raton, 1991.
P. Konton, SMARTplan: A case-based resource allocation and scheduling system, Proceedings of the DARPA Workshop on Care-Based Reasoning Pensacola Beach, FL, M. Kaufmann and K. Hammond, eds., 1989, pp. 285 - 289.
E.L. Lawler, J.K. Lenstra, A.H.G. Rinnooy Kan and D.B. Shmoys, Sequencing and scheduling: Algorithms and complexity, Report BS-R8909, Center for Mathematics and Computer Science, Amsterdam, The Netherlands, 1985.
G.E. Liepins, M.R. Hilliard, M. Palmer and M. Morrow, Greedy genetics, Proceedings of the 2nd International Conference on Genetic Algorithms J.J. Grefenstette, ed., Morgan Kaufmann, 1987, pp. 90 - 99.
G.E. Liepins, M.R. Hilliard, M. Palmer and G. Rangarajan, Credit assignment and discovery in classifier systems, International Journal of Intelligent Systems 6(1991)55-69.
A. Lamatsch, M. Morlock, K. Neumann and T. Rubach, SCHEDULE - an expert-like system for machine scheduling, Annals of Operations Research 6(1988)425 - 438.
D.J. Miller, Simulation of a semiconductor manufacturing line, Communications of the ACM 33 (1990)98 - 108.
S. Piramuthu, S.C. Park, N. Raman and M.J. Shaw, Integration of simulation modeling and inductive learning in an adaptive decision support system, in: Model Management Systems R.H. Bonczek and A.B. Whinston, eds., IEEE Society Press, 1991.
F.A. Rodammer and K.P. White, A recent survey of production scheduling, IEEE Transactions on Systems, Man and Cybernetics 18(1988)841 - 851.
M.J. Shaw, Knowledge-based scheduling in flexible manufacturing systems: An integration of pattern-directed inference and heuristic search, International Journal of Production Research 26 (1988)821 - 844.
M.J. Shaw, N. Raman and S.C. Park, Intelligent scheduling with machine learning capabilities: The induction of scheduling knowledge, Technical Report AI-DSS-91-01, Bechman Institute, University of Illinois, Urbana-Champaign, 1991, to be published in IEE Transactions.
G. Syswerda, Uniform crossover in genetic algorithms, Proceedings of the 3rd International Conference on Genetic Algorithms D. Schaffer, ed., Morgan Kaufmann, 1989, pp. 2 - 9.
L.D. Whitley, T. Starkweather and D. Fuquay, Scheduling problems and the traveling salesman: The genetic edge recombination operator, Proceedings of the 3rd International Conference on Genetic Algorithms D. Schaffer, ed., Morgan Kaufmann, 1989, pp. 133 - 140.
L.D. Whitley, T. Starkweather and D. Shaner, The traveling salesman and sequence scheduling: Quality solutions using genetic edge recombination, in: Handbook of Genetic Algorithms L. Davis, ed., Van Nostrand Reinhold, 1991, pp. 351 - 372.
S.W. Wilson, Classifier systems and the animat problem, Machine Learning 2(1987)199 - 228.
Y. Yih, Trace driven knowledge acquisition for rule based real time scheduling systems, Journal of Intelligent Manufacturing 1(1990)217 - 230.
Rights and permissions
About this article
Cite this article
Aytug, H., Bhattacharyya, S. & Koehler, G.J. Genetic learning through simulation: An investigation in shop floor scheduling. Annals of Operations Research 78, 1–29 (1998). https://doi.org/10.1023/A:1018989730961
Issue Date:
DOI: https://doi.org/10.1023/A:1018989730961