A Decentralized Optimization Algorithm for Multi-Agent Job Shop Scheduling with Private Information
Abstract
:1. Introduction
- An autonomous and parallel evolution of agents is developed, wherein agents individually construct private fitness functions that align with their specific objectives and subsequently evolve independently and concurrently. This process protects private information and ensures the fulfillment of each consumer agent’s requirement.
- A novel evolution method, primarily including crossover between agents, mutation within agents, and agent-based block insertion, is proposed to prevent the algorithm from becoming trapped in local optima while safeguarding the privacy of agents.
- A negotiation decision-making approach comprising non-dominated sorting and grey relational analysis (GRA) is established to generate a final schedule that maximizes social welfare.
2. Problem Statement
2.1. Problem Description
- All jobs and machines are available at time 0;
- Each operation can only be processed on one machine at a time;
- Each machine can only process one operation at any time;
- The preemption of any operation is not allowed;
- The operations of a job should be processed sequentially in a predetermined order.
2.2. Mathematical Model
3. The Proposed GDOA Algorithm
3.1. A Two-Stage GDOA Framework
3.2. Parallel Genetic Evolution
3.2.1. Subpopulation Initialization
Algorithm 1: Subpopulation selection |
Input: J, |
Output: initial subpopulation (k = 1, 2, …, N) 1: JSA randomly generates the initial population Pop 2: for in CA do 3: Construct fitness objective 4: for pop in Pop do 5: Calculate fitness values f(pop) 6: end for 7: Sort f(pop) in ascending order 8: Obtain containing P/N chromosomes with top f(pop) 9: end for 10: Return |
3.2.2. Rearrangement
Algorithm 2: Rearrangement operation |
Input: J, (k = 1, 2, …, N) |
Output: (k = 1, 2, …, N) |
1: Initialize |
2: for in CA do |
3: submit to JSA |
4: Append to FC |
5: end for |
6: Return FC |
7: // JSA modifies FC |
8: |
9: for fc in FC do |
10: |
11: for in J do |
12: Swapping genes on fc to generate a new (as shown in Figure 5) |
13: Append to () |
14: end for |
15: Append to () |
16: Return |
17: // updates subpopulation |
18: |
19: for in CA do |
20: for in do |
21: Calculate fitness values |
22: end for |
23: Sort in ascending order |
24: Generate consisting of P/N chromosomes with top |
25: end for |
26: Return |
3.2.3. Crossover between Agents
Algorithm 3: Crossover between agents. |
Input: (k = 1, 2, …, N), crossover round , reception probability |
Output: (k = 1, 2, …, N) |
1: for in CA do |
2: Initialize , q = 1 |
3: while do |
4: Randomly select from |
5: randomly selects from |
6: submits to |
7: Generate () |
8: |
9: for os in Os do |
10: Crossover os and to create (POX) |
11: Append to |
12: end for |
13: q = q + 1 |
14: Append to () |
15: end while |
16: for cp in do |
17: if then |
18: if random (0,1) < then |
19: Append cp to |
20: end if |
21: end if |
22: end for |
23: Return |
3.2.4. Mutation within Agent
Algorithm 4: Mutation within agent |
Input: (k = 1, 2, …, N), mutation round , crossover probability , mutation probability |
Output: (k = 1, 2, …, N) |
1: for in CA do |
2: Initialize , q = 1 |
3: while do |
4: Select and from based on the roulette wheel selection |
5: if random (0, 1) < then |
6: Crossover and to create and (POX) |
7: else |
8: , |
9: if random (0, 1) < then |
10: Apply the single swap between and to create and |
11: else |
12: , |
13: q = q + 1 |
14: Append (, ) to |
15: end while |
16: end for |
17: Return |
3.2.5. Agent-Based Block Insertion
Algorithm 5: Agent-based block insertion |
Input: J, (k = 1, 2, …, N) |
Output: (k = 1, 2, …, N) |
1: for in CA do |
2: Initialize |
3: for p in do |
4: Define agent-based block |
5: if A = a combination of or more consecutive genes with on p exits then |
6: = A |
7: Modify p to by exchanging with its preceding gene |
8: else |
9: |
10: |
11: end if |
12: Append to |
13: end for |
14: end for |
15: Return |
3.2.6. Parallel Genetic Evolution Algorithm
Algorithm 6: Parallel genetic evolution algorithm |
Input: J, maximum round G |
Output: Final elite set ES |
1: Initialize g = 1 |
2: while g ≤ G do |
3: // CA evolves |
4: for in CA do |
5: Apply Algorithm 1 |
6: Apply Algorithm 2 |
7: Apply Algorithm 3 |
8: Apply Algorithm 4 |
9: Apply Algorithm 5 |
10: Submit to JSA forming collection |
11: end for |
12: // JSA generates ES |
13: Initialize |
14: Construct fitness objective following Equation (11) |
15: for c in do |
16: Calculate fitness values f(c) |
17: end for |
18: Sort f(c) in ascending order |
19: Obtain containing chromosomes with top f(c) |
20: g = g + 1 |
21: Append to |
22: end while |
23: Deleting duplicate chromosomes in forming ES |
24: Return ES |
3.3. Negotiated Decision-Making
3.3.1. Negotiated Sorting
3.3.2. GRA Decision Making
3.3.3. Negotiated Decision-Making Algorithm
Algorithm 7: Negotiated decision-making algorithm |
Input: Final elite set ES |
Output: Final solution |
2: for in CA do |
2: for in ES do |
3: Sort ES according to (12) |
4: Submit (l = k) to JSA |
5: end for |
6: end for |
7: do |
8: Generate a matrix SM based on |
9: Perform non-dominated sorting on SM to produce NSM (13) and NS |
10: Calculate with (14) |
11: Calculate with (15) |
12: for in NS do |
13: Calculate with (16) |
14: end for |
15: Select with |
16: Return |
4. Computational Experiments
4.1. Experiment Setup
4.1.1. Problem Instances
4.1.2. Performance Measurement
4.1.3. Parameter Setting
4.2. Analysis of Results
4.2.1. Experiment 1: Non-Dominated Solution Set
4.2.2. Experiment 2: Final Solution
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
Indexes | |
i | Index of jobs |
j | Index of machines |
i, j | Index of operations |
h | Index of processing position of machine |
Parameters | |
n | Total number of jobs |
N | Number of CA |
m | Number of machines |
Processing time of operation | |
Due date of operation | |
Weight of job | |
Starting energy consumption of | |
Unit processing energy consumption of | |
Unit idle energy consumption of | |
Variables | |
Completion time of | |
Job processed on the hth position of | |
Operation of job that processed on the hth position of | |
Starting time of the operation | |
Completion time of the operation | |
Starting time of the operation | |
Completion time of the operation | |
Total idle time of |
References
- Çaliş, B.; Bulkan, S. A research survey: Review of AI solution strategies of job shop scheduling problem. J. Intell. Manuf. 2015, 26, 961–973. [Google Scholar] [CrossRef]
- Perez-Gonzalez, P.; Framinan, J.M. A common framework and taxonomy for multicriteria scheduling problems with interfering and competing jobs: Multi-agent scheduling problems. Eur. J. Oper. Res. 2014, 235, 1–16. [Google Scholar] [CrossRef]
- Klein, M.; Faratin, P.; Sayama, H.; Bar-Yam, Y. Protocols for negotiating complex contracts. IEEE Intell. Syst. 2003, 18, 32–38. [Google Scholar] [CrossRef]
- Yazdani, M.; Khalili, S.M.; Jolai, F. A parallel machine scheduling problem with two-agent and tool change activities: An efficient hybrid metaheuristic algorithm. Int. J. Comput. Integr. Manuf. 2016, 29, 1075–1088. [Google Scholar] [CrossRef]
- Goli, A.; Ala, A.; Hajiaghaei-Keshteli, M. Efficient multi-objective meta-heuristic algorithms for energy-aware non-permutation flow-shop scheduling problem. Expert Syst. Appl. 2023, 213, 119077. [Google Scholar] [CrossRef]
- Wang, G.; Li, X.; Gao, L.; Li, P. Energy-efficient distributed heterogeneous welding flow shop scheduling problem using a modified MOEA/D. Swarm Evol. Comput. 2021, 62, 100858. [Google Scholar] [CrossRef]
- Yan, R.; Pei, Z. Information asymmetry, pricing strategy and firm’s performance in the retailer- multi-channel manufacturer supply chain. J. Bus. Res. 2011, 64, 377–384. [Google Scholar] [CrossRef]
- Fink, A.; Homberger, J. Decentralized Multi-Project Scheduling. In Handbook on Project Management and Scheduling; Schwindt, C., Zimmermann, J., Eds.; Springer: Cham, Switzerland, 2015; Volume 2, pp. 685–706. [Google Scholar] [CrossRef]
- Owliya, M.; Saadat, M.; Jules, G.G.; Goharian, M.; Anane, R. Agent-Based Interaction Protocols and Topologies for Manufacturing Task Allocation. IEEE Trans. Syst. Man Cybern.-Syst. 2013, 43, 38–52. [Google Scholar] [CrossRef]
- Guizzi, G.; Revetria, R.; Vanacore, G.; Vespoli, S. On the open job-shop scheduling problem: A decentralized multi-agent approach for the manufacturing system performance optimization. Procedia CIRP 2019, 79, 192–197. [Google Scholar] [CrossRef]
- Zeng, C.; Liu, Z.; Tang, J.; Fan, Z.P.; Yan, C. Auction-based approach to the job-shop problem with parallel batch processing and a machine availability constraint. Eng. Optimiz. 2023, 55, 71–88. [Google Scholar] [CrossRef]
- Liu, Y.; Sun, S.; Wang, X.V.; Wang, L. An iterative combinatorial auction mechanism for multi-agent parallel machine scheduling. Int. J. Prod. Res. 2022, 60, 361–380. [Google Scholar] [CrossRef]
- Sun, S.; Zhou, X.; Chang, S. Negotiation Scheduling Algorithm for Multi-agent Job Shop with Private Information. Chin. J. Mech. Eng. 2022, 58, 210–217. [Google Scholar] [CrossRef]
- Homberger, J. A (μ, λ)-coordination mechanism for agent-based multi-project scheduling. OR Spectrum 2012, 34, 107–132. [Google Scholar] [CrossRef]
- Fink, A.; Homberger, J. An ant-based coordination mechanism for resource-constrained project scheduling with multiple agents and cash flow objectives. Flex. Serv. Manuf. J. 2013, 25, 94–121. [Google Scholar] [CrossRef]
- Lang, F.; Fink, A. Learning from the Metaheuristics: Protocols for Automated Negotiations. Group Decis. Negot. 2015, 24, 299–332. [Google Scholar] [CrossRef]
- Gao, J.; Wong, T.; Wang, C. Coordinating patient preferences through automated negotiation: A multiagent systems model for diagnostic services scheduling. Adv. Eng. Inform. 2019, 42, 100934. [Google Scholar] [CrossRef]
- Fink, A.; Gerhards, P. Negotiation mechanisms for the multi-agent multi-mode resource investment problem. Eur. J. Oper. Res. 2021, 295, 261–274. [Google Scholar] [CrossRef]
- Gao, J.; Wong, T.; Selim, B.; Wang, C. VOMA: A Privacy-Preserving Matching Mechanism Design for Community Ride-Sharing. IEEE Trans. Intell. Transp. Syst. 2022, 23, 23963–23975. [Google Scholar] [CrossRef]
- Homberger, J.; Fink, A. Generic negotiation mechanisms with side payments—Design, analysis and application for decentralized resource-constrained multi-project scheduling problems. Eur. J. Oper. Res. 2017, 261, 1001–1012. [Google Scholar] [CrossRef]
- He, N.; Zhang, D.Z.; Yuce, B. Integrated multi-project planning and scheduling—A multiagent approach. Eur. J. Oper. Res. 2022, 302, 688–699. [Google Scholar] [CrossRef]
- Xu, W.; Hu, Y.; Luo, W.; Wang, L.; Wu, R. A multi-objective scheduling method for distributed and flexible job shop based on hybrid genetic algorithm and tabu search considering operation outsourcing and carbon emission. Comput. Ind. Eng. 2021, 157, 107318. [Google Scholar] [CrossRef]
- Epitropakis, M.G.; Plagianakos, V.P.; Vrahatis, M.N. Balancing the exploration and exploitation capabilities of the Differential Evolution Algorithm. In Proceedings of the IEEE Congress on Evolutionary Computation, Hong Kong, China, 1–6 June 2008; pp. 2686–2693. [Google Scholar] [CrossRef]
- Lin, L.; Gen, M. Auto-tuning strategy for evolutionary algorithms: Balancing between exploration and exploitation. Soft Comput. 2009, 13, 157–168. [Google Scholar] [CrossRef]
- Li, X.; Gao, L.; Pan, Q.; Wan, L.; Chao, K.M. An effective hybrid genetic algorithm and variable neighborhood search for integrated process planning and scheduling in a packaging machine workshop. IEEE Trans. Syst. Man Cybern. 2018, 49, 1933–1945. [Google Scholar] [CrossRef]
- Sun, K.; Zheng, D.; Song, H.; Cheng, Z.; Lang, X.; Yuan, W.; Wang, J. Hybrid genetic algorithm with variable neighborhood search for flexible job shop scheduling problem in a machining system. Expert Syst. Appl. 2023, 215, 119359. [Google Scholar] [CrossRef]
- Thevenin, S.; Zufferey, N. Learning variable neighborhood search for a scheduling problem with time windows and rejections. Discret. Appl. Math. 2019, 261, 344–353. [Google Scholar] [CrossRef]
- Qi, X.; Zhang, D.; Lu, H.; Li, R. A GA-Based Scheduling Method for Civil Aircraft Distributed Production with Material Inventory Replenishment Consideration. Mathematics 2023, 11, 3135. [Google Scholar] [CrossRef]
- Wen, X.; Song, Q.; Qian, Y.; Qiao, D.; Wang, H.; Zhang, Y.; Li, H. Effective Improved NSGA-II Algorithm for Multi-Objective Integrated Process Planning and Scheduling. Mathematics 2023, 11, 3523. [Google Scholar] [CrossRef]
- Nguyen, N.T.; Nguyen, T.T.; Roos, M.; Rothe, J. Computational complexity and approximability of social welfare optimization in multiagent resource allocation. Auton. Agents Multi-Agent Syst. 2014, 28, 256–289. [Google Scholar] [CrossRef]
- Javed, S.A.; Gunasekaran, A.; Mahmoudi, A. DGRA: Multi-sourcing and supplier classification through Dynamic Grey Relational Analysis method. Comput. Ind. Eng. 2022, 173, 108674. [Google Scholar] [CrossRef]
- Zhang, C.; Rao, Y.; Li, P. An effective hybrid genetic algorithm for the job shop scheduling problem. Int. J. Adv. Manuf. Technol. 2008, 39, 965–974. [Google Scholar] [CrossRef]
- Deb, K.; Pratap, A.; Agarwal, S.; Meyarivan, T. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 2002, 6, 182–197. [Google Scholar] [CrossRef]
- Liu, Y.; You, K.; Jiang, Y.; Wu, Z.; Liu, Z.; Peng, G.; Zhou, C. Multi-objective optimal scheduling of automated construction equipment using non-dominated sorting genetic algorithm (NSGA-III). Autom. Constr. 2022, 143, 104587. [Google Scholar] [CrossRef]
- Strassl, S.; Musliu, N. Instance space analysis and algorithm selection for the job shop scheduling problem. Comput. Oper. Res. 2022, 141, 105661. [Google Scholar] [CrossRef]
- Yen, G.G.; He, Z. Performance Metric Ensemble for Multiobjective Evolutionary Algorithms. IEEE Trans. Evol. Comput. 2014, 18, 131–144. [Google Scholar] [CrossRef]
n | m | N Number of CA (JSA = 1) | Number of Instances |
---|---|---|---|
10 | 5, 10 | 2–3 | 60 |
15 | 5, 10, 15 | 2–5 | 32 |
20 | 5, 10, 15, 20 | 2–6 | 180 |
30 | 10, 15, 20 | 2–10 | 126 |
40 | 15, 20 | 2–13 | 96 |
50 | 10, 15,2 0 | 2–16 | 240 |
Parameter | GDOA | NSGA-III | GNMS | GTNA |
---|---|---|---|---|
G | 50 | 200 | 50 | 50 |
P | 100 | 100 | 100 | 100 × (N + 1) |
P/N | 100 | 100 | 100 | 100 × (N + 1) |
0.5 | 0.5 | 0.5 | 0.5 | |
0.1 | 0.1 | 0.1 | 0.1 | |
0.6 | -- | -- | -- | |
50 | -- | -- | -- | |
100 × N | -- | -- | -- |
l | GD | Spacing | ||
---|---|---|---|---|
GDOA | NSGA-III | GDOA | NSGA-III | |
3 | 0.286 | 0.181 | 0.069 | 0.028 |
4 | 0.329 | 0.187 | 0.069 | 0.028 |
5 | 0.235 | 0.139 | 0.035 | 0.026 |
6 | 0.181 | 0.091 | 0.030 | 0.032 |
7 | 0.153 | 0.075 | 0.026 | 0.031 |
8 | 0.078 | 0.097 | 0.022 | 0.033 |
9 | 0.120 | 0.153 | 0.024 | 0.033 |
10 | 0.076 | 0.152 | 0.027 | 0.038 |
11 | 0.089 | 0.158 | 0.048 | 0.029 |
12 | 0.043 | 0.123 | 0.047 | 0.035 |
13 | 0.023 | 0.152 | 0.034 | 0.039 |
14 | 0.052 | 0.133 | 0.028 | 0.048 |
15 | 0.022 | 0.156 | 0.031 | 0.058 |
16 | 0.026 | 0.142 | 0.036 | 0.059 |
17 | 0.025 | 0.157 | 0.032 | 0.056 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Zhou, X.; Rao, W.; Liu, Y.; Sun, S. A Decentralized Optimization Algorithm for Multi-Agent Job Shop Scheduling with Private Information. Mathematics 2024, 12, 971. https://doi.org/10.3390/math12070971
Zhou X, Rao W, Liu Y, Sun S. A Decentralized Optimization Algorithm for Multi-Agent Job Shop Scheduling with Private Information. Mathematics. 2024; 12(7):971. https://doi.org/10.3390/math12070971
Chicago/Turabian StyleZhou, Xinmin, Wenhao Rao, Yaqiong Liu, and Shudong Sun. 2024. "A Decentralized Optimization Algorithm for Multi-Agent Job Shop Scheduling with Private Information" Mathematics 12, no. 7: 971. https://doi.org/10.3390/math12070971
APA StyleZhou, X., Rao, W., Liu, Y., & Sun, S. (2024). A Decentralized Optimization Algorithm for Multi-Agent Job Shop Scheduling with Private Information. Mathematics, 12(7), 971. https://doi.org/10.3390/math12070971