面向航天发射任务鲁棒调度的Q学习增强型模因算法

doi:10.16182/j.issn1004731x.joss.25-1147

摘要/Abstract

摘要：

针对机器故障、工序质量返工和工艺变更等多元不确定性影响下的航天发射任务调度现实难题，提出航天发射任务调度鲁棒优化数学模型与增强型模因算法。综合最坏情景下的完工时间、平均最大完工时间和平均工序开始时间偏差构建了加权优化目标的航天发射任务鲁棒优化调度模型。提出一种Q学习增强型模因算法（Q-learning enhanced memetic algorithm， QMA），能够根据种群状态动态地选择交叉父本。仿真实验结果表明：QMA在综合鲁棒性指标上平均优于传统模因算法1.02%，验证了其在平衡调度效率与方案鲁棒性方面的优势，为高可靠性航天发射任务调度提供了有效的决策工具。

关键词: 航天发射任务调度, 不确定性调度, 鲁棒优化, 模因算法, Q学习增强

Abstract:

A robust optimization mathematical model and an enhanced memetic algorithm (MA) for space launch mission scheduling are proposed to address the practical challenges in space launch mission scheduling under the influence of multiple uncertainties such as equipment failure, process rework due to quality issues, and technological changes. A robust optimization scheduling model for space launch missions is built by integrating the makespan under the worst-case scenario, the average maximum makespan, and the average deviation of process start times. A Q-learning enhanced memetic algorithm (QMA) is proposed, which can dynamically select parent solutions based on the population state. Simulation experiments demonstrate that QMA outperforms the traditional MA by an average of 1.02% in the comprehensive robustness metric, verifying its advantage in balancing scheduling efficiency and scheme robustness, and providing an effective decision-support tool for highly reliable space launch mission scheduling.

Key words: space launch mission scheduling, scheduling under uncertainty, robust optimization, memetic algorithm, Q-learning enhanced

中图分类号:

TP18

林蕊,刘晓路,杜永浩等 . 面向航天发射任务鲁棒调度的Q学习增强型模因算法[J]. 系统仿真学报, 2026, 38(10): 3126-3138.

Lin Rui,Liu Xiaolu,Du Yonghao,et al . Q-learning Enhanced Memetic Algorithm for Robust Scheduling of Space Launch Missions[J]. Journal of System Simulation, 2026, 38(10): 3126-3138.

图/表 9

图1

图2

图3

图4

表1

表2

图5

图6

图7

参考文献 26

[1]	包为民, 祁振强. 航天装备体系化仿真发展的思考[J]. 系统仿真学报, 2024, 36(6): 1257-1272.
	Bao Weimin, Qi Zhenqiang. Thinking of Aerospace Equipment Systematization Simulation Technology Development[J]. Journal of System Simulation, 2024, 36(6): 1257-1272.
[2]	田文迪, 胡慕海, 崔南方. 不确定性环境下鲁棒性项目调度研究综述[J]. 系统工程学报, 2014, 29(1): 135-144.
	Tian Wendi, Hu Muhai, Cui Nanfang. Review of Studies on Robust Project Scheduling Under Uncertainty[J]. Journal of Systems Engineering, 2014, 29(1): 135-144.
[3]	Wang Jingjing, Wang Ling. A Cooperative Memetic Algorithm with Learning-based Agent for Energy-aware Distributed Hybrid Flow-Shop Scheduling[J]. IEEE Transactions on Evolutionary Computation, 2022, 26(3): 461-475.
[4]	Zhao Fuqing, Zhang Hui, Wang Ling. A Pareto-based Discrete Jaya Algorithm for Multiobjective Carbon-efficient Distributed Blocking Flow Shop Scheduling Problem[J]. IEEE Transactions on Industrial Informatics, 2023, 19(8): 8588-8599.
[5]	方佳, 陆志强. 考虑设备故障的鲁棒调度计划模板的建模优化[J]. 上海交通大学学报, 2020, 54(12): 1278-1290.
	Fang Jia, Lu Zhiqiang. Modeling and Optimization of Robust Scheduling Template Considering Equipment Failure[J]. Journal of Shanghai Jiao Tong University, 2020, 54(12): 1278-1290.
[6]	张先超. 生产调度鲁棒性指标及其测度方法研究[J]. 工业工程, 2013, 16(6): 14-20.
	Zhang Xianchao. The Robustness Indices and Measuring Methods for Production Scheduling[J]. Industrial Engineering Journal, 2013, 16(6): 14-20.
[7]	张国辉, 吴立辉, 聂黎, 等. 考虑机器故障的柔性作业车间鲁棒调度方法[J]. 系统仿真学报, 2016, 28(4): 867-873.
	Zhang Guohui, Wu Lihui, Nie Li, et al. Robust Flexible Job Shop Scheduling Method with Machine Breakdowns[J]. Journal of System Simulation, 2016, 28(4): 867-873.
[8]	Zhang Ningwei, Zhang Yuli, Song Shiji, et al. A Review of Robust Machine Scheduling[J]. IEEE Transactions on Automation Science and Engineering, 2024, 21(2): 1323-1334.
[9]	Xiao Shichang, Wu Zigao, Hongyan Dui. Resilience-based Surrogate Robustness Measure and Optimization Method for Robust Job-shop Scheduling[J]. Mathematics, 2022, 10(21): 4048.
[10]	Al-Hinai Nasr, Elmekkawy T Y. Robust and Stable Flexible Job Shop Scheduling with Random Machine Breakdowns Using a Hybrid Genetic Algorithm[J]. International Journal of Production Economics, 2011, 132(2): 279-291.
[11]	Luo Yichen, Xu Xiao, Zhang Zhenyuan, et al. A Two-stage Robust Scheduling Optimization of an Energy Hub with Multiple Chance Constraints[J]. IEEE Transactions on Industry Applications, 2025, 61(1): 1246-1255.
[12]	董学军, 邢立宁, 陈英武. 航天器发射多任务并行调度模型及算法[J]. 系统工程与电子技术, 2013, 35(7): 1438-1444.
	Dong Xuejun, Xing Lining, Chen Yingwu. Scheduling Model and Algorithm of Parallel Multitask on Spacecraft Launch[J]. Systems Engineering and Electronics, 2013, 35(7): 1438-1444.
[13]	汤怀钰, 王聪, 张宏立, 等. 机器故障可重入混合流水车间调度问题研究[J]. 控制与决策, 2026, 41(4): 944-954.
	Tang Huaiyu, Wang Cong, Zhang Hongli, et al. Research on Reentrant Hybrid Flow Shop Scheduling Problem with Machine Failure[J]. Control and Decision, 2026, 41(4): 944-954.
[14]	秦红斌, 李晨晓, 唐红涛, 等. 基于MOMA的可重入混合流水车间调度问题研究[J]. 系统仿真学报, 2024, 36(1): 131-148.
	Qin Hongbin, Li Chenxiao, Tang Hongtao, et al. Reentrant Hybrid Flow Shop Scheduling Problem Based on MOMA[J]. Journal of System Simulation, 2024, 36(1): 131-148.
[15]	郭具涛, 戴铮, 张洁, 等. 面向生产扰动的航天制造车间鲁棒性调度方法研究[J]. 工业工程, 2025, 28(2): 69-77.
	Guo Jutao, Dai Zheng, Zhang Jie, et al. A Robust Scheduling Method for Aerospace Manufacturing Workshops with Production Disturbance[J]. Industrial Engineering Journal, 2025, 28(2): 69-77.
[16]	尤一琛, 王艳, 纪志成. 基于博弈论的柔性作业车间动态调度研究[J]. 系统仿真学报, 2021, 33(11): 2579-2588.
	You Yichen, Wang Yan, Ji Zhicheng. Research on Flexible Job-shop Dynamic Scheduling Based on Game Theory[J]. Journal of System Simulation, 2021, 33(11): 2579-2588.
[17]	Díaz Hernán, Juan José Palacios, Díaz Irene, et al. Robust Schedules for Tardiness Optimization in Job Shop with Interval Uncertainty[J]. Logic Journal of the IGPL, 2023, 31(2): 240-254.
[18]	Li Rui, Gong Wenyin, Lu Chao, et al. A Learning-based Memetic Algorithm for Energy-efficient Flexible Job-shop Scheduling with Type-2 Fuzzy Processing Time[J]. IEEE Transactions on Evolutionary Computation, 2023, 27(3): 610-620.
[19]	Zhao Fuqing, Di Shilu, Wang Ling. A Hyperheuristic with Q-learning for the Multiobjective Energy-efficient Distributed Blocking Flow Shop Scheduling Problem[J]. IEEE Transactions on Cybernetics, 2023, 53(5): 3337-3350.
[20]	Cubukcuoglu Aslihan, Karacan Ismet, Ceylan Zeynep, et al. Minimizing Makespan in Ordered Flow Shop Scheduling Using a Robust Genetic Algorithm[J]. Processes, 2025, 13(5): 1583.
[21]	Wang Weihao, Gao Chutong, Shi Leyuan. Robust Optimization on Unrelated Parallel Machine Scheduling with Setup Times[J]. IEEE Transactions on Automation Science and Engineering, 2023, 20(1): 346-360.
[22]	蒋权, 魏静萱. 用于动态柔性作业车间调度的实时调度方法[J]. 系统仿真学报, 2024, 36(7): 1609-1620.
	Jiang Quan, Wei Jingxuan. Real-time Scheduling Method for Dynamic Flexible Job Shop Scheduling[J]. Journal of System Simulation, 2024, 36(7): 1609-1620.
[23]	Du Yonghao, Wang Tao, Xin Bin, et al. A Data-driven Parallel Scheduling Approach for Multiple Agile Earth Observation Satellites[J]. IEEE Transactions on Evolutionary Computation, 2020, 24(4): 679-693.
[24]	Song Yanjie, Ou Junwei, Ponnuthurai Nagaratnam Suganthan, et al. Learning Adaptive Genetic Algorithm for Earth Electromagnetic Satellite Scheduling[J]. IEEE Transactions on Aerospace and Electronic Systems, 2023, 59(6): 9010-9025.
[25]	Song Yanjie, Wei Luona, Yang Qing, et al. RL-GA: A Reinforcement Learning-based Genetic Algorithm for Electromagnetic Detection Satellite Scheduling Problem[J]. Swarm and Evolutionary Computation, 2023, 77: 101236.
[26]	Wu Jian, Yao Feng, Song Yanjie, et al. Frequent Pattern-based Parallel Search Approach for Time-dependent Agile Earth Observation Satellite Scheduling[J]. Information Sciences, 2023, 636: 118924.

案例	工序数量	资源种类	不确定参数
I	10	10	p₁, p₂
II	20	10	p₁, p₂
III	30	10	p₁, p₂
IV	40	20	p₁, p₂
V	50	20	p₁, p₂
VI	60	20	p₁, p₂
VII	70	30	p₁, p₂
VIII	80	30	p₁, p₂
IX	90	30	p₁, p₂
X	100	30	p₁, p₂

案例	HC		LA		TSA		GA		MA		QMA
案例	均值	标准差	均值	标准差	均值	标准差	均值	标准差	均值	标准差	均值	标准差
I	14.26	0.17	14.24	0.17	14.24	0.17	14.15	0.26	14.15	0.26	14.15	0.19
II	20.93	0.26	20.99	0.33	20.99	0.33	20.92	0.37	20.92	0.37	20.92	0.12
III	51.41	0.75	51.54	0.59	51.54	0.59	51.18	1.10	51.18	1.10	50.73	2.06
IV	74.95	0.96	74.77	0.54	74.77	0.55	74.09	1.86	74.09	1.86	72.89	2.89
V	107.47	1.37	107.35	1.25	107.28	1.31	106.21	2.52	106.21	2.52	105.47	0.79
VI	187.49	4.08	188.18	2.88	186.92	4.93	183.61	5.58	181.96	4.92	175.98	4.5
VII	233.05	5.28	232.71	2.42	229.15	3.49	224.74	3.34	217.76	4.06	217.59	5.24
VIII	272.52	7.40	270.22	5.10	264.7	9.24	258.22	5.79	252.44	4.44	251.11	4.74
IX	366.04	10.32	357.37	5.35	349.26	7.51	341.68	6.06	339.66	10.17	338.56	6.75
X	448.05	10.26	441.17	7.76	428.85	6.23	413.78	10.16	402.18	5.86	398.73	7.86