Performance Evaluation Technology for Low Earth Orbit Satellite Internet

doi:10.16182/j.issn1004731x.joss.23-1124

Abstract

Abstract:

Performance evaluation can provide strong support for new technology verification of low earth orbit(LEO) satellite internet. Aiming at the characteristics of flexible networking and large space-time scale of satellite internet, a performance evaluation architecture of satellite internet is designed. Aiming at the characteristics of various performance elements, a performance evaluation index system is designed under the premise of multi-dimensional comprehensive consideration. Aiming at the problem of frequent switching of satellite-ground links caused by high-speed movement, an algorithm for satellite-ground link switching is proposed, which provides support for subsequent collection work. Aiming at the multi-dimensional problem of indicators, a multi-mode collection technology for indicator source data is proposed, which improves the efficiency of data. Aiming at the requirement of how to evaluate performance through a standardized process, a satellite Internet performance evaluation strategy is designed. Experiments show that compared with traditional methods, data acquisition performance improved by 47.16%. It has the ability to realize the systematic and comprehensive performance evaluation of LEO satellite internet.

Key words: low earth orbit(LEO) satellite internet, network emulation, switching emulation, performance evaluation, multi-mode acquisition

CLC Number:

TP391.9

Wang Xiaofeng, Zhang Yi, Zhang Guoxiu. Performance Evaluation Technology for Low Earth Orbit Satellite Internet[J]. Journal of System Simulation, 2025, 37(1): 119-133.

Figures/Tables 19

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Table 1

Fig. 5

Table 2

Table 3

1~9 scale and meaning

$a i j$ 的值	含义
1	$a i$ 和 $a j$ 同样重要
3	$a i$ 比 $a j$ 略重要
5	$a i$ 比 $a j$ 明显重要
7	$a i$ 比 $a j$ 非常重要
9	$a i$ 比 $a j$ 绝对重要
2,4,6,8	上述重要性状态的中间值
倒数	若 $a i j = v$ , $a j i = 1 / v$

Table 3

Fig. 6

Table 4

Table 5

Ground object location information

对象类型	名称	经纬度	高度/m
信关站	Loring	$107 ° W, 48 ° N$	1 050
	Manistique	$86 ° W, 45 ° N$	280
	Casselton	$97 ° W, 46 ° N$	580
用户	New York	$74 ° W, 40 ° N$	305
用户	Seattle	$122 ° W, 47 ° N$	1 000

Table 5

Fig. 7

Table 6

Fig. 8

Fig. 9

Fig. 10

Fig 11

Table 7

Table 8

References 21

1	王子涵, 张娇, 张远, 等. 基于链路信息估计的低轨卫星网络传输控制协议[J]. 计算机研究与发展, 2023, 60(8): 1846-1857.
	Wang Zihan, Zhang Jiao, Zhang Yuan, et al. A Transport Control Protocol for Low Earth Orbit Satellite Networks Based on Link Information Estimation[J]. Journal of Computer Research and Development, 2023, 60(8): 1846-1857.
2	Osoro O B, Oughton E J. A Techno-economic Framework for Satellite Networks Applied to Low Earth Orbit Constellations: Assessing Starlink, OneWeb and Kuiper[J]. IEEE Access, 2021, 9: 141611-141625.
3	Neinavaie M, Khalife J, Kassas Z M. Acquisition, Doppler Tracking, and Positioning with Starlink Leo Satellites: First Results[J]. IEEE Transactions on Aerospace and Electronic Systems, 2022, 58(3): 2606-2610.
4	张更新, 王运峰, 丁晓进, 等. 卫星互联网若干关键技术研究[J]. 通信学报, 2021, 42(8): 1-14.
	Zhang Gengxin, Wang Yunfeng, Ding Xiaojin, et al. Research on Several Key Technologies of Satellite Internet[J]. Journal on Communications, 2021, 42(8): 1-14.
5	西安电子科技大学. 面向天地一体化网络的星座系统能力评估体系及评估系统: CN202110526280.X[P]. 2021-09-24.
6	Yong Dai, Song Jiang, Wang Dayang, et al. A STK-based Constellation Architecture Implementation for 5G Low-orbit Satellites[C]//2022 IEEE 4th International Conference on Power, Intelligent Computing and Systems (ICPICS). Piscataway: IEEE, 2022: 602-606.
7	Si Xiaolong, Ge Rufei, Qian Cheng, et al. Design and Implementation of Space-borne SAR Mission Planning System Based on STK[C]//2022 3rd China International SAR Symposium (CISS). Piscataway: IEEE, 2022: 1-5.
8	Abdelaal Marwa A, Ebrahim Gamal A, Anis Wagdy R. High Availability Deployment of Virtual Network Function Forwarding Graph in Cloud Computing Environments[J]. IEEE Access, 2021, 9: 53861-53884.
9	Valsamas Polychronis, Mamatas Lefteris, Luis Miguel Contreras. A Comparative Evaluation of Edge Cloud Virtualization Technologies[J]. IEEE Transactions on Network and Service Management, 2022, 19(2): 1351-1365.
10	Asim Muhammad, Wang Yong, Wang Kezhi, et al. A Review on Computational Intelligence Techniques in Cloud and Edge Computing[J]. IEEE Transactions on Emerging Topics in Computational Intelligence, 2020, 4(6): 742-763.
11	Lai Junyu, Tian Jiaqi, Zhang Ke, et al. Network Emulation as a Service (NEaaS): Towards a Cloud-based Network Emulation Platform[J]. Mobile Networks and Applications, 2021, 26(2): 766-780.
12	Wang Xiaofeng, Chen Xinyu, Ye Haiyang, et al. Cloud-based Experimental Platform for the Space-ground Integrated Network[J]. Wireless Communications and Mobile Computing, 2020, 2020(1): 8893187.
13	陈新宇. 模型驱动的天地一体化卫星网络高性能动态仿真技术[D]. 无锡: 江南大学, 2022.
	Chen Xinyu. High-performance Dynamic Emulation Technology of Model-driven for Space-ground Integrated Satellite Network[D]. Wuxi: Jiangnan University, 2022.
14	Lai Zeqi, Li Hewu, Li Jihao. StarPerf: Characterizing Network Performance for Emerging Mega-constellations[C]//2020 IEEE 28th International Conference on Network Protocols (ICNP). Piscataway: IEEE, 2020: 1-11.
15	Han Chi, Xiong Wei, Jian Ping. Operational Effectiveness Evaluation of Space-based Information System Based on Improved AHP-BPNN Model[C]//2021 IEEE 5th Information Technology,Networking,Electronic and Automation Control Conference (ITNEC). Piscataway: IEEE, 2021: 1775-1780.
16	Han Chi, Xiong Wei, Xiong Minghui, et al. Effectiveness Evaluation of Reconnaissance Satellite System based on Analytic Hierarchy Process and Cloud Model[C]//2021 IEEE 5th Information Technology,Networking,Electronic and Automation Control Conference (ITNEC). Piscataway: IEEE, 2021: 366-370.
17	Dong Yanlei, Wang Chunting, Sun Chenhua, et al. Performance Evaluation for Satellite Communication Networks Based on AHP-BP Algorithm[C]//2018 10th International Conference on Communication Software and Networks (ICCSN). Piscataway: IEEE, 2018: 311-316.
18	黄颖, 李伟, 简晨, 等. 低轨星座系统的可控波束到地功率通量密度研究[J]. 电信科学, 2022, 38(4): 49-58.
	Huang Ying, Li Wei, Jian Chen, et al. Research on Power Flux-density at the Earth's Surface Produced by Emissions from the Steerable Beam of Leo Constellation System[J]. Telecommunications Science, 2022, 38(4): 49-58.
19	姜辰凯, 李智, 盘书宝, 等. 基于改进Dijkstra算法的AGVs无碰撞路径规划[J]. 计算机科学, 2020, 47(8): 272-277.
	Jiang Chenkai, Li Zhi, Pan Shubao, et al. Collision-free Path Planning of AGVs Based on Improved Dijkstra Algorithm[J]. Computer Science, 2020, 47(8): 272-277.
20	Mondragon A E C, Mastrocinque E, Tsai J F, et al. An AHP and Fuzzy AHP Multifactor Decision Making Approach for Technology and Supplier Selection in the High-functionality Textile Industry[J]. IEEE Transactions on Engineering Management, 2021, 68(4): 1112-1125.
21	刘渊, 薛新毅, 王晓锋. 基于云平台的Starlink星座高性能仿真技术研究[J]. 系统仿真学报, 2022, 34(10): 2221-2232.
	Liu Yuan, Xue Xinyi, Wang Xiaofeng. Research on High-performance Emulation Technology of Starlink Constellation Based on Cloud Platform[J]. Journal of System Simulation, 2022, 34(10): 2221-2232.

报表模板	对象	数据项	说明
Area_Coverage.rst	Coverage Definition	Accum Area Coverage	累积覆盖面积
Time_Coverage.rst	Coverage Definition	Coverage By Latitude-Total Time Covered	按纬度划分的覆盖时间
Plurality_Coverage.rst	Coverage Definition-Figure of Merit	Covered by Latitude-Maximum	按纬度划分的最大覆盖重数
Min_Elevation.rst	Satellite	Semimajor Axis	半长轴
Min_Elevation.rst	Satellite-Sensor	Cone Half Angle	半圆锥角

维度	指标	性质	性能评价
覆盖能力	面积覆盖率	正向	卫星覆盖面积性能
	时间覆盖率	正向	卫星覆盖时间性能
	覆盖重数	正向	卫星覆盖密度性能
	最小仰角	正向	卫星覆盖角度性能
通信容量	星座容量	正向	星座传输容量性能
通信容量	单星容量	正向	单星传输容量性能
通信能力	端到端时延	负向	用户平均通信时延性能
通信能力	端到端丢包率	负向	用户成功传输数据性能
服务能力	通信时长	正向	用户通信服务时长性能
	中断时长	负向	用户通信服务有效性
	中断次数	负向	用户通信服务稳定性

对比方法	对比项	New York	Seattle
星地链路仿真方法	切换次数	1	1
星地链路仿真方法	通信时间/min	2	2
本文方法	切换次数	60	67
本文方法	通信时间/min	109	120

维度范畴	指标项	指标源数据值			指标标准化值
维度范畴	指标项	场景a	场景b	场景c	场景a	场景b	场景c
覆盖能力	面积覆盖率	85.76%	85.76%	85.76%	1	1	1
	时间覆盖率	16.86%	19.60%	23.64%	0.71	0.82	1
	覆盖重数	2	2	2	1	1	1
	最小仰角	40°	40°	40°	1	1	1
通信容量	星座容量	2.56 Gbit/s	3.16 Gbit/s	3.37 Gbit/s	0.75	0.93	1
通信容量	单星容量	11.92 Mbit/s	12.26 Mbit/s	10.47 Mbit/s	0.97	1	0.85
通信能力	端到端时延	46.56 ms	42.90 ms	61.25 ms	0.92	1	0.7
通信能力	端到端丢包率	83.33%	79.16%	71.31%	0.85	0.90	1
服务能力	通信时长	4 h	5 h	6 h53 min	0.58	0.72	1
	中断时长	20 h	19 h	17 h7 min	0.85	0.90	1
	中断次数	32	41	50	1	0.78	0.64

场景	评估结果	排名
a	0.837	3
b	0.895	2
c	0.948	1