Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
survey

A Survey of AI-enabled Dynamic Manufacturing Scheduling: From Directed Heuristics to Autonomous Learning

Published: 17 July 2023 Publication History

Abstract

As one of the most complex parts in manufacturing systems, scheduling plays an important role in the efficient allocation of resources to meet individual customization requirements. However, due to the uncertain disruptions (e.g., task arrival time, service breakdown duration) of manufacturing processes, how to respond to various dynamics in manufacturing to keep the scheduling process moving forward smoothly and efficiently is becoming a major challenge in dynamic manufacturing scheduling. To solve such a problem, a wide spectrum of artificial intelligence techniques have been developed to (1) accurately construct dynamic scheduling models that can represent both personalized customer needs and uncertain provider capabilities and (2) efficiently obtain a qualified schedule within a limited time. From these two perspectives, this article systemically makes a state-of-the-art literature survey on the application of these artificial intelligence techniques in dynamic manufacturing modeling and scheduling. It first introduces two types of dynamic scheduling problems that consider service- and task-related disruptions in the manufacturing process, respectively, followed by a bibliometric analysis of artificial intelligence techniques for dynamic manufacturing scheduling. Next, various kinds of artificial-intelligence-enabled schedulers for solving dynamic scheduling problems including both directed heuristics and autonomous learning methods are reviewed, which strive not only to quickly obtain optimized solutions but also to effectively achieve the adaption to dynamics. Finally, this article further elaborates on the future opportunities and challenges of using artificial-intelligence-enabled schedulers to solve complex dynamic scheduling problems. In summary, this survey aims to present a thorough and organized overview of artificial-intelligence-enabled dynamic manufacturing scheduling and shed light on some related research directions that are worth studying in the future.

References

[1]
X. Xu, Y. Lu, B. Vogel-Heuser, and L. Wang. 2021. Industry 4.0 and industry 5.0 - Inception, conception and perception.Journal of Manufacturing Systems 61 (2021), 530–535.
[2]
M. D. Nardo and H. Yu. 2021. Industry 5.0: The prelude to the sixth industrial revolution.Applied System Innovation 4, 3 (2021), 45.
[3]
M. Zarandi, A. Asl, S. Sotudian, and O. Castillo. 2020. A state of the art review of intelligent scheduling. Artificial Intelligence Review 53 (2020), 501–593.
[4]
Y. Liu, L. Wang, X. Wang, X. Xu, and L. Zhang. 2019. Scheduling in cloud manufacturing: State-of-the art and research challenges.International Journal of Production Research 57, 15–16 (2019), 4854–4879.
[5]
A. Giret, D. Trentesaux, and V. Prabhu. 2015. Sustainability in manufacturing operations scheduling: A state of the art review. Journal of Manufacturing Systems 37, 1 (2015), 126–140.
[6]
D. Rossit, F. Tohmé, and M. Frutos. 2018. The non-permutation flow-shop scheduling problem: A literature review. Omega 77 (2018), 143–153.
[7]
E. Edis, C. Oguz, and I. Ozkarahan. 2013. Parallel machine scheduling with additional resources: Notation, classification, models and solution methods. European Journal of Operational Research 230, 3 (2013), 449–463.
[8]
R. Ojstersek and M. Brezocnik. 2020. Multi-objective optimization of production scheduling with evolutionary computation: A review. International Journal of Industrial Engineering Computations 11 (2020), 359–376.
[9]
P. Robert, P. Nathalie, and B. Francois. 2020. A survey of hybrid metaheuristics for the resource-constrained project scheduling problem. European Journal of Operation Research 280, 2 (2020), 395–416.
[10]
H. Singh, S. Tyagi, and P. Kumar. 2019. Scheduling in cloud computing environment using metaheuristic techniques: A survey.Emerging Technology in Modelling and Graphics 937 (2019), 753–763.
[11]
P. Priore, A. Gómez, R. Pino, and R. Rosillo. 2014. Dynamic scheduling of manufacturing systems using machine learning: An updated review. Artificial Intelligence for Engineering Design, Analysis and Manufacturing 28, 1 (2014), 83–97.
[12]
Y. Liu, L. Zhang, L. Wang, Y. Xiao, X. Xu, and M. Wang. 2019. A framework for scheduling in cloud manufacturing with deep reinforcement learning. In Proceedings of the 17th IEEE International Conference on Industrial Informatics (INDIN’19), 1775–1780.
[13]
E. TAillard. 1993. Benchmarks for basic scheduling problems. European Journal of Operational Research 64, 2 (1993), 278–285.
[14]
E. Demirkol, S. Mehta, and R. Uzsoy. 1998. Benchmarks for shop scheduling problems. European Journal of Operational Research 109, 1 (1998), 137–141.
[15]
I. Kacem, S. Hammadi, and P. Borne. 2002. Approach by localization and multiobjective evolutionary optimization for flexible job-shop scheduling problems. IEEE Transactions on Systems, Man and Cybernetics 32, 1 (2002), 1–13.
[16]
D. Lee and F. DiCesare. 1994. Scheduling flexible manufacturing systems using petri nets and heuristic search. IEEE Transactions on Robotics and Automation 10, 2 (1994), 123–132.
[17]
P. Brandimarte. 1993. Routing and scheduling in a flexible job shop by tabu search. Annals of Operations Research 41 (1993), 157–183.
[18]
J. Ding, Y. Wang, S. Zhang, W. Zhang, and Z. Xiong. 2019. Robust and stable multi-task manufacturing scheduling with uncertainties using a two-stage extended genetic algorithm. Enterprise Information Systems 13, 10 (2019), 1442–1470.
[19]
Y. Yang, M. Huang, Z. Wang, and Q. Zhu. 2020. Robust scheduling based on extreme learning machine for bi-objective flexible job-shop problems with machine breakdowns. Expert Systems with Applications 158, 15 (2020), 113545.
[20]
D. Ouelhadj and S. Petrovic. 2009. A survey of dynamic scheduling in manufacturing systems.Journal of Scheduling 12 (2009), 417–431.
[21]
Z. Wu, S. Sun, and S. Xiao. 2018. Risk measure of job shop scheduling with random machine breakdowns. Computers & Operations Research 99 (2018), 1–12.
[22]
N. Al-Hinai and T. ElMekkawy. 2011. Robust and stable flexible job shop scheduling with random machine breakdowns using a hybrid genetic algorithm. International Journal of Production Economics 132, 2 (2011), 279–291.
[23]
E. Ahmadi, M. Zandieh, M. Farrokh, and S. Emami. 2016. A multi objective optimization approach for flexible job shop scheduling problem under random machine breakdown by evolutionary algorithms. Computers & Operations Research 73 (2016), 56–66.
[24]
K. Peng, Q. Pan, L. Gao, B. Zhang, and X. Pang. 2018. An improved artificial bee colony algorithm for real-world hybrid flowshop rescheduling in steelmaking-refining-continuous casting process. Computers & Industrial Engineering 122 (2018), 235–250.
[25]
M. Haddadzade, M. Razfar, and M. Zarandi. 2014. Integration of process planning and job shop scheduling with stochastic processing time. International Journal of Advanced Manufacturing Technology 71 (2014), 241–252.
[26]
V. Ghezavati and M. Saidi-Mehrabad. 2010. Designing integrated cellular manufacturing systems with scheduling considering stochastic processing time. International Journal of Advanced Manufacturing Technology 48 (2010), 701–717.
[27]
J. Lin, C. Chiu, and Y. Chang. 2019. Simulation-based optimization approach for simultaneous scheduling of vehicles and machines with processing time uncertainty in FMS. Flexible Services and Manufacturing Journal 31 (2019), 104–141.
[28]
C. Lu, S. Lin, and K. Ying. 2012. Robust scheduling on a single machine to minimize total flow time.Computers & Operations Research 39, 7 (2012), 1682–1691.
[29]
R. Li, W. Gong, and C. Lu. 2022. A reinforcement learning based RMOEA/D for bi-objective fuzzy flexible job shop scheduling. Expert Systems With Applications 203 (2022), 117380.
[30]
K. Wang and S. Choi. 2014. A holonic approach to flexible flow shop scheduling under stochastic processing times. Computers & Operations Research 43 (2014), 157–168.
[31]
L. Nie, L. Gao, P. Li, and X. Shao. 2013. Reactive scheduling in a job shop where jobs arrive over time. Computers & Industrial Engineering 66, 2 (2013), 389–405.
[32]
D. Johnson, G. Chen, and Y. Lu. 2022. Multi-agent reinforcement learning for real-time dynamic production scheduling in a robot assembly cell. IEEE Robotics and Automation Letters 7, 2 (2022), 7684–7691.
[33]
B. Luo, S. Wang, B. Yang, and L. Yi. 2021. An improved deep reinforcement learning approach for the dynamic job shop scheduling problem with random job arrivals. Journal of Physics: Conference Series 1848, 1 (2021), 012029.
[34]
D. Rahmani and R. Ramezanian. 2016. A stable reactive approach in dynamic flexible flow shop scheduling with unexpected disruptions: A case study. Computers & Industrial Engineering 98 (2016), 360–372.
[35]
B. Han and J. Yang. 2020. Research on adaptive job shop scheduling problems based on dueling double DQN. IEEE Access 8 (2020), 186474–186495.
[36]
J. Shahrabi, M. Adibi, and M. Mahootchi. 2017. A reinforcement learning approach to parameter estimation in dynamic job shop scheduling. IEEE Robotics and Automation Letters 110 (2017), 75–82.
[37]
D. Wang, F.J. Wang, and Y. Wang. 2016. Integrated rescheduling and preventive maintenance for arrival of new jobs through evolutionary multi-objective optimization. Soft Computing 20 (2016), 1635–1652.
[38]
J. Chen, M. Wang, X. Kong, G. Huang, Q. Dai, and G. Shi. 2019. Manufacturing synchronization in a hybrid flowshop with dynamic order arrivals. Journal of Intelligent Manufacturing 30 (2019), 2659–2668.
[39]
S. Chen, S. Fang, and R. Tang. 2018. A reinforcement learning based approach for multi-projects scheduling in cloud manufacturing. International Journal of Production Research 57, 10 (2018), 3080–3098.
[40]
S. Luo. 2020. Dynamic scheduling for flexible job shop with job insertions by deep reinforcement learning.Applied Soft Computing 91 (2020), 106208.
[41]
L. Hu, Z. Liu, W. Hu, Y. Wang, J. Tan, and F. Wu. 2020. Petri-net-based dynamic scheduling of flexible manufacturing system via deep reinforcement learning with graph convolutional network.Journal of Manufacturing Systems 55 (2020), 1–14.
[42]
S. Qu, T. Chu, J. Wang, J. Leckie, and W. Jian. 2015. A centralized reinforcement learning approach for proactive scheduling in manufacturing. In Proceedings of the 20th IEEE Conference on Emerging Technologies & Factory Automation (ETFA’15), (1–8).
[43]
H. Rahman, R. Sarker, and D. Essam. 2018. Multiple-order permutation flow shop scheduling under process interruptions. International Journal of Advanced Manufacturing Technology 97 (2018), 2781–2808.
[44]
L. Zhang, L. Gao, and X. Li. 2013. A hybrid intelligent algorithm and rescheduling technique for job shop scheduling problems with disruptions.International Journal of Advanced Manufacturing Technology 65 (2013), 1141–1156.
[45]
Y. Li, Y. He, Y. Wang, F. Tao, and J. Sutherland. 2020. An optimization method for energy-conscious production in flexible machining job shops with dynamic job arrivals and machine breakdowns. Journal of Cleaner Production 254, 1 (2020), 120009.
[46]
F. Liu, S. Wang, Y. Hong, and X. Yue. 2017. On the robust and stable flowshop scheduling under stochastic and dynamic disruptions.IEEE Transactions on Engineering Management 64, 4 (2017), 539–553.
[47]
C. Pang and C. Le. 2014. Optimization of total energy consumption in flexible manufacturing systems using weighted p-timed petri nets and dynamic programming. IEEE Transactions on Automation Science and Engineering 11, 1 (2014), 1083–1096.
[48]
S. Shim and Y. Kim. 2008. A branch and bound algorithm for an identical parallel machine scheduling problem with a job splitting property. Computers & Operations Research 35, 3 (2008), 863–875.
[49]
J. Pereira and M. Vilà. 2015. An exact algorithm for the mixed-model level scheduling problem. International Journal of Production Research 53, 19 (2015), 5809–5825.
[50]
L. Zeballos. 2010. A constraint programming approach to tool allocation and production scheduling in flexible manufacturing systems. Robotics and Computer-Integrated Manufacturing 26, 6 (2010), 725–743.
[51]
J. Cheng, H. Kise, and H. Matsumoto. 1997. A branch-and-bound algorithm with fuzzy inference for a permutation flowshop scheduling problem. European Journal of Operational Research 96, 3 (1997), 578–590.
[52]
A. Yenipazarli, H. Benson, and S. Erenguc. 2016. A branch-and-bound algorithm for the concave cost supply problem.International Journal of Production Research 54, 13 (2016), 3943–3961.
[53]
J. Liou. 2020. Dominance conditions determination based on machine idle times for the permutation flowshop scheduling problem. Computers & Operations Research 122 (2020), 104964.
[54]
[55]
X. Li, K. Xing, M. Zhou, X. Wang, and Y. Wu. 2019. Modified dynamic programming algorithm for optimization of total energy consumption in flexible manufacturing systems. IEEE Transactions on Automation Science and Engineering 16, 2 (2019), 691–705.
[56]
W. Lunardi, E. Birgin, D. Ronconi, and H. Voos. 2021. Metaheuristics for the online printing shop scheduling problem. European Journal of Operational Research 293, 2 (2021), 419–441.
[57]
A. Telikani, A. Tahmassebi, W. Banzhaf, and A. H. Gandomi. 2021. Evolutionary machine learning: A survey. Comput. Surveys 54, 8 (2021), 1–35.
[58]
P. Wang. 2019. On defining artificial intelligence. Journal of Artificial General Intelligence 10, 2 (2019), 1–37.
[59]
J. Zhang, G. Ding, Y. Zou, S. Qin, and J. Fu. 2019. Review of job shop scheduling research and its new perspectives under Industry 4.0. Journal of Intelligent Manufacturing 30 (2019), 1809–1830.
[60]
C. Zhang, X. Dong, X. Wang, X. Li, and Q. Liu. 2010. Improved NSGA-II for the multiobjective flexible job-shop scheduling problem.Journal of Engineering Mechanics 46, 11 (2010), 159–163.
[61]
X. Jiang, Z. Tian, W. Liu, Y. Suo, K. Chen, X. Xu, and Z. Li. 2022. Energy-efficient scheduling of flexible job shops with complex processes: A case study for the aerospace industry complex components in China. Journal of Industrial Information Integration 27 (2022), 100293.
[62]
D. Lei. 2010. Solving fuzzy job shop scheduling problems using random key genetic algorithm. International Journal of Advanced Manufacturing Technology 49, 1 (2010), 253–262.
[63]
W. Zhang, J. Ding, Y. Wang, S. Zhang, and Z. Xiong. 2019. Multi-perspective collaborative scheduling using extended genetic algorithm with interval-valued intuitionistic fuzzy entropy weight method. Journal of Manufacturing Systems 53 (2019), 249–260.
[64]
G. Rey, A. Bekrar, V. Prabhu, and D. Trentesaux. 2014. Coupling a genetic algorithm with the distributed arrival-time control for the JIT dynamic scheduling of flexible job-shops. International Journal of Production Research 52, 12 (2014), 3688–3709.
[65]
J. Kennedy and R. Eberhart. 1995. Particle swarm optimization. International Conference on Neural Networks 4 (1995), 1942–1948.
[66]
S. Saeedi, R. Khorsand, S. Bidgoli, and M. Ramezanpour. 2020. Improved many-objective particle swarm optimization algorithm for scientific workflow scheduling in cloud computing.Computers & Industrial Engineering 147 (2020), 106649.
[67]
J. Jian, L. Wang, H. Chen, and X. Nie. 2020. Scheduling optimization of time-triggered cyber-physical systems based on fuzzy-controlled QPSO and SMT solver. Energies 13, 3 (2020), 668.
[68]
T. Jamrus, C. Chien, M. Gen, and K. Sethanan. 2018. Hybrid particle swarm optimization combined with genetic operators for flexible job-shop scheduling under uncertain processing time for semiconductor manufacturing. IEEE Transactions on Semiconductor Manufacturing 31, 1 (2018), 32–41.
[69]
Z. Wang, J. Zhang, and S. Yang. 2019. An improved particle swarm optimization algorithm for dynamic job shop scheduling problems with random job arrivals. Swarm and Evolutionary Computation 51 (2019), 100594.
[70]
R. Zhang, S. Song, and C. Wu. 2020. Robust scheduling of hot rolling production by local search enhanced ant colony optimization algorithm. IEEE Transactions on Industrial Informatics 16, 4 (2020), 2809–2819.
[71]
K. Gao, P. Suganthan, Q. Pan, M. Tasgetiren, and A. Sadollah. 2016. Artificial bee colony algorithm for scheduling and rescheduling fuzzy flexible job shop problem with new job insertion. Knowledge-Based Systems 109, 1 (2016), 1–16.
[72]
K. Gao, P. Suganthan, Q. Pan, T. Chua, C. Chong, and T. Cai. 2016. An improved artificial bee colony algorithm for flexible job-shop scheduling problem with fuzzy processing time.Expert Systems with Applications 65, 15 (2016), 52–67.
[73]
W. Xu, Z. Ji, and Y. Wang. 2018. A flower pollination algorithm for flexible job shop scheduling with fuzzy processing time.Modern Physics Letters B 32 (2018), 1840113.
[74]
J. Lin. 2015. A hybrid biogeography-based optimization for the fuzzy flexible job-shop scheduling problem.Knowledge-Based Systems 78 (2015), 59–74.
[75]
I. Strumberger, N. Bacanin, M. Tuba, and E. Tuba. 2019. Resource scheduling in cloud computing based on a hybridized whale optimization algorithm.Applied Sciences 9, 22 (2019), 4893.
[76]
Z. Zhang, L. Zheng, and M. Weng. 2007. Dynamic parallel machine scheduling with mean weighted tardiness objective by Q-Learning.International Journal of Advanced Manufacturing Technology 34 (2007), 968–980.
[77]
Y. Wang. 2018. Adaptive job shop scheduling strategy based on weighted Q-learning algorithm. Journal of Intelligent Manufacturing 31 (2018), 417–432.
[78]
F. Zhao, L. Zhang, J. Cao, and J. Tang. 2021. A cooperative water wave optimization algorithm with reinforcement learning for the distributed assembly no-idle flowshop scheduling problem. Computers & Industrial Engineering 153 (2021), 107082.
[79]
X. Shen, Y. Han, and J. Fu. 2017. Robustness measures and robust scheduling for multi-objective stochastic flexible job shop scheduling problems. Soft Computing 21 (2017), 6531–6554.
[80]
B. Wang, X. Wang, and H. Xie. 2018. Bad-scenario-set robust scheduling for a job shop to hedge against processing time uncertainty. International Journal of Production Research 57, 10 (2018), 3168–3185.
[81]
Z. Cao, C. Lin, and M. Zhou. 2015. A knowledge-based cuckoo search algorithm to schedule a flexible job shop with sequencing flexibility. IEEE Transactions on Automation Science and Engineering 53, 19 (2015), 5809–5825.
[82]
J. Park, J. Chun, S. Kim, Y. Kim, and J. Park. 2021. Learning to schedule job-shop problems: Representation and policy learning using graph neural network and reinforcement learning.International Journal of Production Research 59, 11 (2021), 3360–3377.
[83]
P. Zheng, P. Zhang, J. Wang, J. Zhang, C. Yang, and Y. Jin. 2020. A data-driven robust optimization method for the assembly job-shop scheduling problem under uncertainty. International Journal of Computer Integrated Manufacturing 35, 10–11 (2020), 1043–1058.
[84]
K. Dooley and F. Mahmoodi. 1992. Identification of robust scheduling heuristics: Application of Taguchi methods in simulation studies. Computers & Industrial Engineering 22, 4 (1992), 359–368.
[85]
C. Liu, C. Chang, and C. Tseng. 2020. Actor-critic deep reinforcement learning for solving job shop scheduling problems. IEEE Access 8 (2020), 71752–71762.
[86]
G. Hinton and R. Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. Science 313 (2006), 504–507.
[87]
W. Wu, Z. Huang, J. Zeng, and K. Fan. 2021. A fast decision-making method for process planning with dynamic machining resources via deep reinforcement learning. Journal of Manufacturing Systems 58 (2021), 392–411.
[88]
L. Wang, X. Hu, Y. Wang, S. Xu, S. Ma, K. Yang, Z. Liu, and W. Wang. 2021. Dynamic job-shop scheduling in smart manufacturing using deep reinforcement learning.Computer Networks 190, 8 (2021), 107969.
[89]
Y. Vishwakarma and S. Sharma. 2016. Uncertainty analysis of an industrial system using intuitionistic fuzzy set theory. International Journal of System Assurance Engineering and Management 7, 1 (2016), 73–83.
[90]
D. Rani, T. Gulati, and H. Garg. 2016. Multi-objective non-linear programming problem in intuitionistic fuzzy environment: Optimistic and pessimistic view point. Expert Systems with Applications 64 (2016), 228–238.
[91]
J. Han, Y. Liu, L. Luo, and M. Mao. 2020. Integrated production planning and scheduling under uncertainty: A fuzzy bi-level decision-making approach. Knowledge-Based Systems 201–202, 9 (2020), 106056.
[92]
I. González-Rodríguez, J. Puente, J. Palacios, and C. Vela. 2020. Multi-objective evolutionary algorithm for solving energy-aware fuzzy job shop problems. Soft Computing 24 (2020), 16291–16302.
[93]
A. Shukla, R. Nath and P. Muhuri. 2015. Energy efficient task scheduling with Type-2 fuzzy uncertainty. 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Istanbul, 2015, 1–8. DOI:
[94]
T. Ruppert, G. Dorgo, and J. Abonyi. 2020. Fuzzy activity time-based model predictive control of open-station assembly lines.Journal of Manufacturing Systems 54 (2020), 12–23.
[95]
A. Aydilek, H. Aydilek, and A. Allahverdi. 2017. Algorithms for minimizing the number of tardy jobs for reducing production cost with uncertain processing times.Applied Mathematical Modelling 45 (2017), 982–996.
[96]
G. Bodaghi, F. Jolai, and M. Rabbani. 2018. An integrated weighted fuzzy multi-objective model for supplier selection and order scheduling in a supply chain. International Journal of Production Research 56, 10 (2018), 3590–3614.
[97]
X. Zhang, Y. Deng, L. Chan, P. Xu, M. Sankaran, and Y. Hu. 2013. IFSJSP: A novel methodology for the job-shop scheduling problem based on intuitionistic fuzzy sets.International Journal of Production Research 51, 17 (2013), 5100–5119.
[98]
S. Zhang and S. Wang. 2018. Flexible assembly job-shop scheduling with sequence-dependent setup times and part sharing in a dynamic environment: Constraint programming model, mixed-integer programming model, and dispatching rules. IEEE Transactions on Engineering Management 65, 3 (2018), 487–504.
[99]
J. Zheng, L. Wang, and J. Wang. 2020. A cooperative coevolution algorithm for multi-objective fuzzy distributed hybrid flow shop. Knowledge-Based Systems 194, 22 (2020), 105536.
[100]
J. Lin. 2020. Backtracking search based hyper-heuristic for the flexible job-shop scheduling problem with fuzzy processing time.Engineering Applications of Artificial Intelligence 77 (2020), 186–196.
[101]
B. Liu, Y. Fan, and Y. Liu. 2015. A fast estization of distribution algorithm for dynamic fuzzy flexible job-shop scheduling problem.Computers & Industrial Engineering 87 (2015), 193–201.
[102]
V. Sonmez, M. Testik, and O. Testik. 2018. Overall equipment effectiveness when production speeds and stoppage durations are uncertain. International Journal of Advanced Manufacturing Technology 95 (2018), 121–130.
[103]
X. Shen and X. Yao. 2015. Mathematical modeling and multi-objective evolutionary algorithms applied to dynamic flexible job shop scheduling problems.Information Sciences 298, 20 (2015), 198–224.
[104]
S. Goren, I. Sabuncuoglu, and U. Koc. 2012. Optimization of schedule stability and efficiency under processing time variability and random machine breakdowns in a job shop environment. Naval Research Logistics 59, 1 (2012), 26–38.
[105]
M. Al-Behadili, D. Ouelhadj, and D. Jones. 2020. Multi-objective biased randomised iterated greedy for robust permutation flow shop scheduling problem under disturbances.Journal of the Operational Research Society 71, 11 (2020), 1847–1859.
[106]
K. Ying. 2015. Scheduling the two-machine flowshop to hedge against processing time uncertainty. Journal of Operational Research Society 66 (2015), 1413–1425.
[107]
V. Leon, S. Wu, and R. Storer. 1994. Robustness measures and robust scheduling for job shops. IIE Transactions 26, 5 (1994), 32–43.
[108]
D. Rahmani and M. Heydari. 2014. Robust and stable flow shop scheduling with unexpected arrivals of new jobs and uncertain processing times. Journal of Manufacturing Systems 33, 1 (2014), 84–92.
[109]
A. Zanchettin. 2021. Robust scheduling and dispatching rules for high-mix collaborative manufacturing systems. Flexible Services and Manufacturing Journal (2021), 1–24.
[110]
Z. Chang, J. Ding, and S. Song. 2018. Distributionally robust scheduling on parallel machines under moment uncertainty. European Journal of Operational Research 272, 3 (2018), 832–846.
[111]
C. Lu, K. Ying, and S. Lin. 2014. Robust single machine scheduling for minimizing total flow time in the presence of uncertain processing times. Computers & Industrial Engineering 74 (2014), 102–110.
[112]
L. Liu, H. Gu, and Y. Xi. 2007. Robust and stable scheduling of a single machine with random machine breakdowns. International Journal of Advanced Manufacturing Technology 31, 7–8 (2007), 645–654.
[113]
R. Larsen and M. Pranzo. 2019. A framework for dynamic rescheduling problems. International Journal of Production Research 57, 1–2 (2019), 16–33.
[114]
F. Angel-Bello, J. Vallikavungal, and A. Alvarez. 2021. Fast and efficient algorithms to handle the dynamism in a single machine scheduling problem with sequence-dependent setup times.Computers & Industrial Engineering 152 (2021), 106984.
[115]
A. Delgoshaei, M. Ariffin, and A. Ali. 2016. A multi-period scheduling method for trading-off between skilled-workers allocation and outsource service usage in dynamic CMS.International Journal of Production Research 55, 4 (2016), 997–1039.
[116]
M. Aryanezhad, V. Deljoo, and S. Al e hashem. 2009. Dynamic cell formation and the worker assignment problem: A new model.International Journal of Advanced Manufacturing Technology 3–4 (2009), 329–342.
[117]
A. Delgoshaei and A. Ali. 2017. An applicable method for scheduling temporary and skilled-workers in dynamic cellular manufacturing systems using hybrid ant colony optimization and tabu search algorithms. Journal of Industrial and Production Engineering 34, 6 (2017), 425–449.
[118]
H. Chen, B. Du, and G. Huang. 2010. Metaheuristics to minimise makespan on parallel batch processing machines with dynamic job arrivals.International Journal of Computer Integrated Manufacturing 23, 10 (2010), 942–956.
[119]
S. Zhou, M. Jin, and N. Du. 2020. Energy-efficient scheduling of a single batch processing machine with dynamic job arrival times. Energy 209, 15 (2020), 118420.
[120]
Z. Cao, C. Lin, M. Zhou, and J. Zhang. 2020. Surrogate-assisted symbiotic organisms search algorithm for parallel batch processor scheduling. IEEE-ASME Transactions on Mechatronics 25, 5 (2020), 2155–2166.
[121]
J. Pei, X. Liu, P. Pardalos, W. Fan, S. Yang, and L. Wang. 2014. Application of an effective modified gravitational search algorithm for the coordinated scheduling problem in a two-stage supply chain.International Journal of Production Research 70 (2014), 335–348.
[122]
J. Pei, X. Liu, W. Fan, P. Pardalos, A. Migdalas, B. Goldengorin, and S. Yang. 2016. Minimizing the makespan for a serial-batching scheduling problem with arbitrary machine breakdown and dynamic job arrival. International Journal of Advanced Manufacturing Technology 86 (2016), 3315–3331.
[123]
K. Gao, P. Suganthan, M. Tasgetiren, Q. Pan, and Q. Sun. 2015. Effective ensembles of heuristics for scheduling flexible job shop problem with new job insertion. Computers & Industrial Engineering 90 (2015), 107–117.
[124]
K. Wang and S. Choi. 2012. A decomposition-based approach to flexible flow shop scheduling under machine breakdown. International Journal of Production Research 50, 1 (2012), 215–234.
[125]
S. Wang and Y. Li. 2014. Variable neighbourhood search and mathematical programming for just-in-time job-shop scheduling problem. Mathematical Problems in Engineering 2014 (2014), 431325.
[126]
M. Ahmadian, A. Salehipour, and T. Cheng. 2021. A meta-heuristic to solve the just-in-time job-shop scheduling problem. European Journal of Operational Research 288 (2021), 14–29.
[127]
M. Pinedo and K Hadavi. Scheduling: Theory, Algorithms and Systems Development. Heidelberg: Spinger.
[128]
A. Lackorzyński, A. Warg, M. Völp, and H. Härtig. 2012. Flattening hierarchical scheduling. In Proceedings of the 10th ACM International Conference on Embedded Software, 93–102.
[129]
L. Zhang, X. Li, L. Wen, and G. Zhang. 2013. An efficient memetic algorithm for dynamic flexible job shop scheduling with random job arrivals. International Journal of Software Science & Computational Intelligence 5, 1 (2013), 63–77.
[130]
A. Syed, D. Pérez, and G. Fohler. 2018. Job-shifting: An algorithm for online admission of non-preemptive aperiodic tasks in safety critical systems.Journal of Systems Architecture 85–86 (2018), 14–27.
[131]
L. Zhou, L. Zhang, B. Sarker, Y. Laili, and L. Ren. 2018. An event-triggered dynamic scheduling method for randomly arriving tasks in cloud manufacturing .International Journal of Computer Integrated Manufacturing 31, 3 (2018), 318–333.
[132]
X. Sun, S. Chung, F. Chan, and Z. Wang. 2018. The impact of liner shipping unreliability on the production-distribution scheduling of a decentralized manufacturing system.Transportation Research Part E 114 (2018), 242–269.
[133]
P. Hsu, M. Aurisicchio, and P. Angeloudis. 2019. Risk-averse supply chain for modular construction projects. Automation in Construction 106 (2019), 102898.
[134]
M. Vieira, H. Paulo, T. Pinto-Varela, and A. Barbosa-Póvoa. 2020. Assessment of financial risk in the design and scheduling of multipurpose plants under demand uncertainty.International Journal of Production Research 5 (2020), 1–21.
[135]
Z. Wang, T. Ng, and C. Pang. 2021. Due-date quotation model for manufacturing system scheduling under uncertainty. Discrete Event Dynamic Systems 4 (2021), 1–23.
[136]
A. Xanthopoulos, D. Koulouriotis, V. Tourassis, and D. Emiris. 2013. Intelligent controllers for bi-objective dynamic scheduling on a single machine with sequence-dependent setups.Applied Soft Computing 13, 12 (2013), 4704–4717.
[137]
Y. Shiue, K. Lee, and C. Su. 2018. Real-time scheduling for a smart factory using a reinforcement learning approach. Computers & Industrial Engineering 125 (2018), 604–614.
[138]
P. Paraschos, G. Koulinas, and D. Koulouriotis. 2020. Reinforcement learning for combined production-maintenance and quality control of a manufacturing system with deterioration failures. Journal of Manufacturing Systems 56 (2020), 470–483.
[139]
X. Li, J. Wang, and R. Sawhney. 2012. Reinforcement learning for joint pricing, lead-time and scheduling decisions in make-to-order systems.European Journal of Operational Research 221, 1 (2012), 99–109.
[140]
W. Han, F. Guo, and X. Su. 2019. A reinforcement learning method for a hybrid flow-shop scheduling problem. Algorithms 12, 11 (2019), 222.
[141]
C. Lin, D. Deng, Y. Chih, and H. Chiu. 2019. Smart manufacturing scheduling with edge computing using multiclass deep Q network. IEEE Transactions on Industrial Informatics 15, 7 (2019), 4276–4284.
[142]
L. Zhou, L. Zhang, and B. Horn. 2020. Deep reinforcement learning-based dynamic scheduling in smart manufacturing.Procedia CIRP 93 (2020), 383–388.
[143]
Y. Tsai, C. Lee, T. Liu, T. Chang, C. Wang, S. Pawar, P. Huang, and J. Huang. 2020. Utilization of a reinforcement learning algorithm for the accurate alignment of a robotic arm in a complete soft fabric shoe tongues automation process.Journal of Manufacturing Systems 56 (2020), 501–513.
[144]
A. Kintsakis, F. Psomopoulos, and P. Mitkas. 2019. Reinforcement learning based scheduling in a workflow management system. Engineering Applications of Artificial Intelligence 81 (2019), 94–106.
[145]
H. Zhu, M. Li, Y. Tang, and Y. Sun. 2020. A deep-reinforcement-learning-based optimization approach for real-time scheduling in cloud manufacturing. IEEE Access 8 (2020), 9987–9997.
[146]
A. Kuhnle, J. Kaiser, F. Theiß, N. Stricker, and G. Lanza. 2021. Designing an adaptive production control system using reinforcement learning. Journal of Intelligent Manufacturing 32 (2021), 855–876.
[147]
F. Chan, H. Chan, H. Lau, and R. Ip. 2003. Analysis of dynamic dispatching rules for a flexible manufacturing system.Journal of Materials Processing Technology 138, 1–3 (2003), 325–331.
[148]
Y. Wang and J. Usher. 2005. Application of reinforcement learning for agent-based production scheduling. Engineering Applications of Artificial Intelligence 18, 1 (2005), 73–82.
[149]
Y. Shiue. 2009. Data-mining-based dynamic dispatching rule selection mechanism for shop floor control systems using a support vector machine approach. International Journal of Production Research 47, 13 (2009), 3669–3690.
[150]
I. Chaouch, O. Driss, and K. Ghedira. 2019. A novel dynamic assignment rule for the distributed job shop scheduling problem using a hybrid ant-based algorithm. Applied Intelligence 49 (2019), 1903–1924.
[151]
E. Silva, M. Costa, M. Silva, and F. Pereira. 2014. Simulation study of dispatching rules in stochastic job shop dynamic scheduling. World Journal of Modelling and Simulation 10, 3 (2014), 231–240.
[152]
W. Mouelhi-Chibani and H. Pierreval. 2010. Training a neural network to select dispatching rules in real time.Computers & Industrial Engineering 58, 2 (2010), 249–256.
[153]
H. Min and Y. Yih. 2003. Selection of dispatching rules on multiple dispatching decision points in real-time scheduling of a semiconductor wafer fabrication system. International Journal of Production Research 41, 16 (2003), 3921–3941.
[154]
Y. Wang and J. Usher. 2004. Learning policies for single machine job dispatching.Robotics and Computer-Integrated Manufacturing 20, 6 (2004), 553–562.
[155]
H. Xiong, H. Fan, G. Jiang, and G. Li. 2017. A simulation-based study of dispatching rules in a dynamic job shop scheduling problem with batch release and extended technical precedence constraints.European Journal of Operational Research 257, 1 (2017), 13–24.
[156]
R. Guh, Y. Shiue, and T. Tseng. 2011. The study of real time scheduling by an intelligent multi-controller approach. International Journal of Production Research 49, 10 (2011), 2977–2997.
[157]
M. Aydin and E. Öztemel. 2000. Dynamic job-shop scheduling using reinforcement learning agents. Robotics and Autonomous Systems 33 (2000), 169–178.
[158]
G. Metan, I. Sabuncuoglu, and H. Pierreval. 2010. Real time selection of scheduling rules and knowledge extraction via dynamically controlled data mining. International Journal of Production Research 48, 23 (2010), 6909–6938.
[159]
C. Geiger, R. Uzsoy, and H. Aytuğ. 2006. Rapid modeling and discovery of priority dispatching rules: An autonomous learning approach. Journal of Scheduling 9 (2006), 7–34.
[160]
C. Pickardt, T. Hildebrandt, J. Branke, J. Heger, and B. Scholz-Reiter. 2013. Evolutionary generation of dispatching rule sets for complex dynamic scheduling problems. International Journal of Production Economics 145, 1 (2013), 67–77.
[161]
A. Teymourifar, G. Ozturk, Z. Ozturk, and O. Bahadir. 2020. Extracting new dispatching rules for multi-objective dynamic flexible job shop scheduling with limited buffer spaces. Cognitive Computation 12 (2020), 195–205.
[162]
A. Asghari, M. Sohrabi, and F. Yaghmaee. 2020. Online scheduling of dependent tasks of cloud’s workflows to enhance resource utilization and reduce the makespan using multiple reinforcement learning-based agents.Soft Computing 24 (2020), 16177–16199.
[163]
Y. Wang and J. Usher. 2007. A reinforcement learning approach for developing routing policies in multi-agent production scheduling. International Journal of Advanced Manufacturing Technology 33 (2007), 323–333.
[164]
Y. Lee and R. Sikora. 2019. Application of adaptive strategy for supply chain agent.Information Systems and e-Business Management 17, 1 (2019), 117–157.
[165]
S. Baer, J. Bakakeu, R. Meyes, and T. Meisen. 2019. Multi-agent reinforcement learning for job shop scheduling in flexible manufacturing systems. In 2019 Second International Conference on Artificial Intelligence for Industries (AI4I’19), 22–25.
[166]
I. Park, J. Huh, J. Kim, and J. Park. 2020. A reinforcement learning approach to robust scheduling of semiconductor manufacturing facilities.IEEE Transactions on Automation Science and Engineering 17, 3 (2020), 1420–1431.
[167]
R. Lu, Y. Li, Y. Li, J. Jiang, and Y. Ding. 2020. Multi-agent deep reinforcement learning based demand response for discrete manufacturing systems energy management. Applied Energy 276 (2020), 115473.
[168]
S. Qu, J. Wang, and J. Jasperneite. 2018. Dynamic scheduling in large-scale stochastic processing networks for demand-driven manufacturing using distributed reinforcement learning. In IEEE 23rd International Conference on Emerging Technologies and Factory Automation (ETFA’18), 433–440.
[169]
T. Gabel and M. Riedmiller. 2012. Distributed policy search reinforcement learning for job-shop scheduling tasks. International Journal of Production Research 50, 1 (2012), 41–61.
[170]
A. Kuhnle, J. Jakubik, and G. Lanza. 2019. Reinforcement learning for opportunistic maintenance optimization. Production Engineering 13 (2019), 33–41.
[171]
A. Orhean, F. Pop, and I. Raicu. 2018. New scheduling approach using reinforcement learning for heterogeneous distributed systems. J. Parallel and Distrib. Comput. 117 (2018), 292–302.
[172]
M. Silva, S. Souza, M. Souza, and A. Bazzan. 2019. A reinforcement learning-based multi-agent framework applied for solving routing and scheduling problems. Expert Systems with Applications 131, 1 (2019), 148–171.
[173]
Q. Tan, Y. Tong, S. Wu, and D. Li. 2019. Modeling, planning, and scheduling of shop-floor assembly process with dynamic cyber-physical interactions: A case study for CPS-based smart industrial robot production. International Journal of Advanced Manufacturing Technology 105 (2019), 3979–3989.
[174]
A. Asghari, M. Sohrabi, and F. Yaghmaee. 2019. A cloud resource management framework for multiple online scientific workflows using cooperative reinforcement learning agents. Computer Networks 179, 9 (2019), 107340.
[175]
Y. Wang, H. Liu, W. Zheng, Y. Xia, Y. Li, P. Chen, K. Guo, and H. Xie. 2019. Multi-objective workflow scheduling with deep-Q-network-based multi-agent reinforcement learning. IEEE Access 7 (2019), 39974–39982.
[176]
S. Chen, S. Fang, and R. Tang. 2019. A reinforcement learning based approach for multi-projects scheduling in cloud manufacturing. International Journal of Production Research 57, 10 (2019), 3080–3098.
[177]
Y. Kim, S. Lee, J. Son, H. Bae, and B. Chung. 2020. Multi-agent system and reinforcement learning approach for distributed intelligence in a flexible smart manufacturing system. Journal of Manufacturing Systems 57 (2020), 440–450.

Cited By

View all
  • (2024)Empowering Virtual Machine-Controlled and AI-Controlled Robots for Transportation in the Manufacturing IndustryContemporary Solutions for Sustainable Transportation Practices10.4018/979-8-3693-3755-4.ch016(436-466)Online publication date: 30-Jun-2024
  • (2024)A Healthcare System Employing Lightweight CNN for Disease Prediction with Artificial IntelligenceThe Open Public Health Journal10.2174/011874944530202324052011180217:1Online publication date: 6-Jun-2024
  • (2024)Correlated Equilibrium based Online Real-time Distributed Dynamic Task Scheduler for Multi-agent Systems2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10650142(1-10)Online publication date: 30-Jun-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Computing Surveys
ACM Computing Surveys  Volume 55, Issue 14s
December 2023
1355 pages
ISSN:0360-0300
EISSN:1557-7341
DOI:10.1145/3606253
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 July 2023
Online AM: 01 April 2023
Accepted: 14 February 2023
Revised: 16 October 2022
Received: 16 August 2021
Published in CSUR Volume 55, Issue 14s

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Artificial intelligence
  2. dynamic scheduling
  3. directed heuristic
  4. autonomous learning
  5. manufacturing system

Qualifiers

  • Survey

Funding Sources

  • Natural Science Foundation of China
  • Shanghai Trusted Industry Internet Software Collaborative Innovation Center, Shanghai Gaofeng & Gaoyuan Project for University Academic Program Development
  • “Digital Silk Road” Shanghai International Joint Lab of Trustworthy Intelligent Software

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)569
  • Downloads (Last 6 weeks)45
Reflects downloads up to 11 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Empowering Virtual Machine-Controlled and AI-Controlled Robots for Transportation in the Manufacturing IndustryContemporary Solutions for Sustainable Transportation Practices10.4018/979-8-3693-3755-4.ch016(436-466)Online publication date: 30-Jun-2024
  • (2024)A Healthcare System Employing Lightweight CNN for Disease Prediction with Artificial IntelligenceThe Open Public Health Journal10.2174/011874944530202324052011180217:1Online publication date: 6-Jun-2024
  • (2024)Correlated Equilibrium based Online Real-time Distributed Dynamic Task Scheduler for Multi-agent Systems2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10650142(1-10)Online publication date: 30-Jun-2024
  • (2024)An opinions-updating model for large-scale group decision-making driven by autonomous learningInformation Sciences: an International Journal10.1016/j.ins.2024.120238662:COnline publication date: 25-Jun-2024

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media