Peer-to-peer Energy-carbon Management Method of Multiple Integrated Energy Systems Considering Multi-agent Interaction Strategy

doi:10.16182/j.issn1004731x.joss.23-0731

Abstract

Abstract:

To explore a new energy management model of P2P transaction of electricity, heat and carbon among IES with the participation of ESP, a P2P energy-carbon management method of IES considering multi-agent interaction strategy is proposed. A two-layer energy management framework with the multi-agent participation of involving ESP and IES is established. A two-layer electricity-heat-carbon energy management model is constructed in which the upper model is constructed based on reinforcement learning framework to optimize the energy management strategy between ESP and IES cooperative alliance and the lower model is based on Nash negotiation game theory to optimize the cooperative operation strategy among multiple IESs. A typical system is taken as an example to analyze the optimal energy management strategy of IES under P2P mode. The results show that the proposed method can effectively conduct electricity-heat scheduling, maximize system benefits and reduce carbon emissions.

Key words: integrated energy system, energy service provider, peer-to-peer transaction, energy management, cooperative operation

CLC Number:

TP391

Wang Yudong, Hu Junjie. Peer-to-peer Energy-carbon Management Method of Multiple Integrated Energy Systems Considering Multi-agent Interaction Strategy[J]. Journal of System Simulation, 2024, 36(10): 2488-2502.

Figures/Tables 22

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Table 1

Table 2

Fig. 5

Fig. 6

Fig. 7

Fig. 9

Fig. 8

Fig. 10

Fig. 11

Fig. 12

Fig. 13

Fig. 14

Fig. 15

Table 3

Table 4

Fig. 16

Table 5

Fig. 17

References 37

1	王俐英, 林嘉琳, 董厚琦, 等. 计及阶梯式碳交易的综合能源系统优化调度[J]. 系统仿真学报, 2022, 34(7): 1393-1404.
	Wang Liying, Lin Jialin, Dong Houqi, et al. Optimal Dispatch of Integrated Energy System Considering Ladder-type Carbon Trading[J]. Journal of System Simulation, 2022, 34(7): 1393-1404.
2	栗海润, 穆云飞, 贾宏杰, 等. 考虑量化储热的多区域电-热综合能源系统优化调度[J]. 中国电机工程学报, 2021, 41(增1): 16-27.
	Li Hairun, Mu Yunfei, Jia Hongjie, et al. Optimal Scheduling of Multi-regional Integrated Power and Heating System Considering Quantified Thermal Storage[J]. Proceedings of the CSEE, 2021, 41(S1): 16-27.
3	Huang Yujing, Wang Yudong, Liu Nian. Low-carbon Economic Dispatch and Energy Sharing Method of Multiple Integrated Energy Systems from the Perspective of System of Systems[J]. Energy, 2022, 244, Part A: 122717.
4	张凡, 高红均, 吴子豪, 等. 局域能源市场多产消者P2P交易框架设计[J]. 电力自动化设备, 2022, 42(12): 17-25.
	Zhang Fan, Gao Hongjun, Wu Zihao, et al. Design of P2P Trading Framework for Multiple Prosumers in Local Energy Market[J]. Electric Power Automation Equipment, 2022, 42(12): 17-25.
5	张帅, 裴玮, 马腾飞, 等. 考虑马尔可夫决策的产消者P2P电能交易非合作博弈模型[J]. 电力系统自动化, 2023, 47(13): 18-27.
	Zhang Shuai, Pei Wei, Ma Tengfei, et al. Non-cooperative Game Model of Prosumer P2P Electricity Trading Considering Markov Decision[J]. Automation of Electric Power Systems, 2023, 47(13): 18-27.
6	胡健, 于娣, 张晓杰. 电力P2P交易中计及社会福利的产消者合作联盟[J]. 中国电机工程学报, 2024, 44(3): 960-970.
	Hu Jian, Yu Di, Zhang Xiaojie. Prosumer Alliance in P2P Transaction of Electricity Considering Social Welfare[J]. Proceedings of the CSEE, 2024, 44(3): 960-970.
7	袁全, 王红艳, 周磊. 计及P2P交易的多冷热电联供型微网联合调度模型[J]. 电气自动化, 2023, 45(1): 42-46.
	Yuan Quan, Wang Hongyan, Zhou Lei. Joint Scheduling Model of Multi Cooling, Heating and Power Cogeneration Microgrid Considering P2P Transaction[J]. Electrical Automation, 2023, 45(1): 42-46.
8	刘可真, 董敏, 杨春昊, 等. 基于纳什谈判的智能园区P2P电能交易优化运行[J]. 电力自动化设备, 2023, 43(5): 45-53.
	Liu Kezhen, Dong Min, Yang Chunhao, et al. Optimal Operation of P2P Electric Power Trading in Smart Park Based on Nash Negotiation[J]. Electric Power Automation Equipment, 2023, 43(5): 45-53.
9	沈开程. 考虑交易成本和配网安全约束的分布式能源P2P交易研究[D]. 杭州: 浙江大学, 2022.
	Shen Kaicheng. Research on Peer-to-peer Trading of Distributed Energy considering Transaction Cost and Distribution Network Security Constraints[D]. Hangzhou: Zhejiang University, 2022.
10	雷杰宇, 高仕斌, 韦晓广, 等. 基于股权分配的能源市场P2P能量共享交易模型[J]. 中国电机工程学报, 2022, 42(23): 8548-8562.
	Lei Jieyu, Gao Shibin, Wei Xiaoguang, et al. A Shareholding-based Energy Sharing Transaction Model for Energy Market Among Peer-to-peer Prosumers[J]. Proceedings of the CSEE, 2022, 42(23): 8548-8562.
11	崇志强, 陈培育, 李树青, 等. 基于合作博弈论的P2P电力交易方法[J]. 电力系统及其自动化学报, 2021, 33(12): 87-92, 100.
	Chong Zhiqiang, Chen Peiyu, Li Shuqing, et al. P2P Energy Trading Method Based on Cooperative Game Theory[J]. Proceedings of the CSU-EPSA, 2021, 33(12): 87-92, 100.
12	郭琳, 陈先锋, 邓惠华, 等. 含分布式电源P2P交易的社区微网运营机制[J]. 电力建设, 2018, 39(7): 1-9.
	Guo Lin, Chen Xianfeng, Deng Huihua, et al. A Framework of Operating Mechanism Based on Peer-to-peer Transaction Among Distributed Energy Resources in Community Microgrid[J]. Electric Power Construction, 2018, 39(7): 1-9.
13	林永君, 陈鑫, 杨凯, 等. 含多微网的主动配电网双层分布式优化调度[J]. 系统仿真学报, 2022, 34(11): 2323-2336.
	Lin Yongjun, Chen Xin, Yang Kai, et al. Bilevel Distributed Optimal Dispatch of Active Distribution Network with Multi-microgrids[J]. Journal of System Simulation, 2022, 34(11): 2323-2336.
14	魏利胜, 杨奔奔, 孙瑞霞. 基于新型BBO算法的微电网优化调度研究[J]. 系统仿真学报, 2023, 35(5): 1075-1085.
	Wei Lisheng, Yang Benben, Sun Ruixia. Research on Optimal Scheduling of Microgrid Based on NBBO Algorithm[J]. Journal of System Simulation, 2023, 35(5): 1075-1085.
15	李文翔, 李晔, 董洁霜, 等. 引入碳交易机制的新能源汽车发展路径研究[J]. 系统仿真学报, 2021, 33(6): 1451-1465.
	Li Wenxiang, Li Ye, Dong Jieshuang, et al. Development Paths of New Energy Vehicles Incorporating CO₂ Emissions Trading Scheme[J]. Journal of System Simulation, 2021, 33(6): 1451-1465.
16	崔杨, 曾鹏, 仲悟之, 等. 考虑阶梯式碳交易的电-气-热综合能源系统低碳经济调度[J]. 电力自动化设备, 2021, 41(3): 10-17.
	Cui Yang, Zeng Peng, Zhong Wuzhi, et al. Low-carbon Economic Dispatch of Electricity-gas-heat Integrated Energy System Based on Ladder-type Carbon Trading[J]. Electric Power Automation Equipment, 2021, 41(3): 10-17.
17	杨欢红, 谢明洋, 黄文焘, 等. 含废物处理的城市综合能源系统低碳经济运行策略[J]. 电网技术, 2021, 45(9): 3545-3552.
	Yang Huanhong, Xie Mingyang, Huang Wentao, et al. Low-carbon Economic Operation of Urban Integrated Energy System Including Waste Treatment[J]. Power System Technology, 2021, 45(9): 3545-3552.
18	葛少云, 程雪颖, 刘洪, 等. 园区多微网P2P电-碳耦合交易市场设计[J]. 高电压技术, 2023, 49(4): 1341-1349.
	Ge Shaoyun, Cheng Xueying, Liu Hong, et al. Market Design of P2P Electricity Carbon Coupling Transaction Among Multi-microgrids in a Zone[J]. High Voltage Engineering, 2023, 49(4): 1341-1349.
19	沈思辰, 韩海腾, 周亦洲, 等. 基于条件风险价值的多虚拟电厂电-碳-备用P2P交易模型[J]. 电力系统自动化, 2022, 46(18): 147-157.
	Shen Sichen, Han Haiteng, Zhou Yizhou, et al. Electricity-carbon-reserve Peer-to-peer Trading Model for Multiple Virtual Power Plants Based on Conditional Value-at-risk[J]. Automation of Electric Power Systems, 2022, 46(18): 147-157.
20	王再闯, 陈来军, 李笑竹, 等. 基于合作博弈的能源共享模式下多园区低碳优化调度[J]. 高电压技术, 2023, 49(4): 1380-1391.
	Wang Zaichuang, Chen Laijun, Li Xiaozhu, et al. Multi-park Low-carbon Optimal Scheduling Under Energy Sharing Mode Based on Cooperative Game[J]. High Voltage Engineering, 2023, 49(4): 1380-1391.
21	Sun Guoqiang, Zhang Zheyu, Zhou Yizhou, et al. Bi-level Model for Integrated Energy Service Providers in Joint Electricity and Carbon P2P Market[J]. Journal of Cleaner Production, 2023, 393: 136303.
22	马立新, 程颍. 计及可中断负荷的园区综合能源系统优化调度[J]. 系统仿真学报, 2022, 34(4): 817-825.
	Ma Lixin, Cheng Ying. Optimal Operation for Park Integrated Energy System Considering Interruptible Loads[J]. Journal of System Simulation, 2022, 34(4): 817-825.
23	陈瑜玮, 孙宏斌, 郭庆来. 综合能源系统分析的统一能路理论(五):电-热-气耦合系统优化调度[J]. 中国电机工程学报, 2020, 40(24): 7928-7937.
	Chen Yuwei, Sun Hongbin, Guo Qinglai. Energy Circuit Theory of Integrated Energy System Analysis (V): Integrated Electricity-heat-gas Dispatch[J]. Proceedings of the CSEE, 2020, 40(24): 7928-7937.
24	闫园, 林鸿基, 文福拴, 等. 考虑电价和碳价间Copula风险依赖的虚拟电厂竞标策略[J]. 电力建设, 2019, 40(11): 106-115.
	Yan Yuan, Lin Hongji, Wen Fushuan, et al. Bidding Strategy of a Virtual Power Plant Considering Copula Risk Dependence of Electricity and Carbon Prices[J]. Electric Power Construction, 2019, 40(11): 106-115.
25	王祺, 王承民, 谢宁, 等. 混合CVaR-IGDT的区域综合能源系统扩展规划模型[J]. 电网技术, 2020, 44(2): 505-513.
	Wang Qi, Wang Chengmin, Xie Ning, et al. A Hybrid CVaR-IGDT Expansion Planning Model for Regional Integrated Energy System[J]. Power System Technology, 2020, 44(2): 505-513.
26	肖勇, 戚锦通, 胡伟, 等. 基于双层规划模型的燃煤发电机组初始碳排放配额分配方案研究[J]. 热力发电, 2022, 51(10): 42-46.
	Xiao Yong, Qi Jintong, Hu Wei, et al. Initial Carbon Emission Quota Allocation Scheme for Coal-fired Power Units Based on Bi-level Programming Model[J]. Thermal Power Generation, 2022, 51(10): 42-46.
27	Li Ruizhi, Yan Xiaohe, Liu Nian. Hybrid Energy Sharing Considering Network Cost for Prosumers in Integrated Energy Systems[J]. Applied Energy, 2022, 323: 119627.
28	张松枝. 基于季节负荷差异性的区域综合能源系统模型[J]. 系统仿真学报, 2021, 33(3): 562-571.
	Zhang Songzhi. Regional Integrated Energy System Model Based on Seasonal Load Difference[J]. Journal of System Simulation, 2021, 33(3): 562-571.
29	林卓然, 王守相, 王绍敏, 等. 考虑阶梯型碳交易机制的区域电-热综合能源系统分布协同调度方法[J]. 电网技术, 2023, 47(1): 217-225.
	Lin Zhuoran, Wang Shouxiang, Wang Shaomin, et al. Distributed Coordinated Dispatching of District Electric-thermal Integrated Energy System Considering Ladder-type Carbon Trading Mechanism[J]. Power System Technology, 2023, 47(1): 217-225.
30	Huang Yujing, Wang Yudong, Liu Nian. A Two-stage Energy Management for Heat-electricity Integrated Energy System Considering Dynamic Pricing of Stackelberg Game and Operation Strategy Optimization[J]. Energy, 2022, 244, Part A: 122576.
31	Lu Renzhi, Ho Hong Seung, Zhang Xiongfeng. A Dynamic Pricing Demand Response Algorithm for Smart Grid: Reinforcement Learning Approach[J]. Applied Energy, 2018, 220: 220-230.
32	高雪莹, 唐昊, 苗刚中, 等. 储能系统能量调度与需求响应联合优化控制[J]. 系统仿真学报, 2016, 28(5): 1165-1172.
	Gao Xueying, Tang Hao, Miao Gangzhong, et al. Joint Optimization Control of Energy Storage System Management and Demand Response[J]. Journal of System Simulation, 2016, 28(5): 1165-1172.
33	马腾飞, 裴玮, 肖浩, 等. 基于纳什谈判理论的风-光-氢多主体能源系统合作运行方法[J]. 中国电机工程学报, 2021, 41(1): 25-39.
	Ma Tengfei, Pei Wei, Xiao Hao, et al. Cooperative Operation Method for Wind-solar-hydrogen Multi-agent Energy System Based on Nash Bargaining Theory[J]. Proceedings of the CSEE, 2021, 41(1): 25-39.
34	黄海涛, 陈曦, 查俊吉. 多园区综合能源系统分区自治式能量合作社区及联合优化调度[J]. 电网技术, 2022, 46(8): 2955-2963.
	Huang Haitao, Chen Xi, Zha Junji. Partition Autonomous Energy Cooperation Community and Its Joint Optimal Scheduling for Multi-park Integrated Energy System[J]. Power System Technology, 2022, 46(8): 2955-2963.
35	上海环境能源交易所. 全国碳排放权交易数据[EB/OL]. (2023-06-08)[2023-06-08]. .
36	张晓辉, 刘小琰, 钟嘉庆. 考虑奖惩阶梯型碳交易和电-热转移负荷不确定性的综合能源系统规划[J]. 中国电机工程学报, 2020, 40(19): 6132-6141.
	Zhang Xiaohui, Liu Xiaoyan, Zhong Jiaqing. Integrated Energy System Planning Considering a Reward and Punishment Ladder-type Carbon Trading and Electric-thermal Transfer Load Uncertainty[J]. Proceedings of the CSEE, 2020, 40(19): 6132-6141.
37	高瑞阳, 王新宝, 高娴, 等. 考虑灵活性资源和多能共享的低碳区域综合能源系统联盟-配电网博弈优化调度[J]. 南方电网技术, 2024, 18(2): 77-88.
	Gao Ruiyang, Wang Xinbao, Gao Xian, et al. Optimal Dispatching of Low-carbon Regional Integrated Energy System Alliance and Distribution Network Game Considering Flexible Resources and Multi Energy Sharing[J]. Southern Power System Technology, 2024, 18(2): 77-88.

设备	参数	IES1	IES2	IES3
CHP	机组容量/kW	1 500	1 000	—
	运维系数/(元/kW)	0.05	0.05	—
	热电比	1.35	1.41	—
EB	机组容量/kW	1 500	—	1 000
	运维系数/(元/kW)	0.026	—	0.026
	制热系数	0.90	—	0.86
GB	机组容量/kW	—	—	1 500
	运维系数/(元/kW)	—	—	0.15
	制热系数	—	—	0.85
PV	机组容量/kW	1 000	1 000	2 500
PV	运维系数/(元/kW)	0.025	0.025	0.025
EES	机组容量/kW	1 000	500	1 000
EES	运维系数/(元/kW)	0.02	0.02	0.02
TES	机组容量/kW	1 000	—	—
TES	运维系数/(元/kW)	0.02	—	—

时段	售电价	购电价
01:00-08:00	0.45	0.40
09:00-11:00；16:00-17:00；23:00-24:00	0.86
12:00-15:00 18:00-22:00	1.35

运行效益	优化结果
总运行效益	2 639.47
与UES间电热交互收益	-30 453.93
与IES间电热交互收益	28 989.04
管网服务收益	4 104.36

运行成本	IES1	IES2	IES3
综合运行成本	37 904.14	35 525.01	25 385.37
与ESP间的交易成本	13 987.75	-1 559.75	16 561.05
P2P电能交易成本	-4 407.15	4 597.70	-190.55
P2P热能交易成本	103.53	-103.53	0
P2P碳配额交易成本	0	-174.10	174.10
超额碳排放惩罚成本	0	0	126.25
天然气成本	20 533.90	27 470.27	3 839.84
运维成本	5 781.19	3 422.87	4 546.80
管网服务费	1 904.93	2 052.18	147.25
风险成本	0	-180.63	180.63

对比指标	本文决策方法	Stackelberg博弈
ESP总运行效益/元	2 639.47	2 726.31
IES总成本/元	98 814.52	109 968.56
求解时间/s	32.63	56.82
收敛代数	18	29