Design of Optical Compound Eye Simulation Software for Small Aircraft Applications

doi:10.16182/j.issn1004731x.joss.21-0317

Abstract

Abstract:

Optical compound eye has the advantages of large field of view, multiple viewing angles and high resolution. With another advantage that it can conformal combine with small aircraft, optical compound eye has application value in reconnaissance and surveillance, target detection, image navigation and other aspects. An optical compound eye simulation software for small aircraft is designed for the current situation of long development period of optical compound eye design and high cost of flight test in practical applications. The software integrates compound eye imaging, aircraft simulation and data management, and each functional module is extensible. The simulation results show that the frame rate can reach 23.3 fps under the configuration of 9 sub-eyes, and the results are accurate. The software can be used for the optimization of optical compound eye design scheme and the test of processing algorithms, which is of great significance to the development of aircraft application.

Key words: optical compound eye, aircraft, simulation software, Unigine, Qt

CLC Number:

TP391.9

Qiming Qi, Ruigang Fu, Ping Wang, Min Wang, Hongqi Fan. Design of Optical Compound Eye Simulation Software for Small Aircraft Applications[J]. Journal of System Simulation, 2022, 34(09): 1999-2008.

Figures/Tables 19

Fig. 1

Fig. 2

Table 1

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Table 2

Fig. 9

Fig. 10

Fig. 11

Table 3

Table 4

Fig. 12

Table 5

Fig. 13

Fig. 14

References 16

[1]	文超, 马涛, 王偲, 等. 昆虫复眼结构及视觉导航研究进展[J]. 应用昆虫学报, 2019, 56(1): 28-36.
	Wen Chao, Ma Tao, Wang Cai, et al. Progress in Research on the Compound Eye Structure and Visual Navigation of Insects[J]. Chinese Journal of Applied Entomology, 2019, 56(1): 28-36.
[2]	Wu Sidong, Jiang Tao, Zhang Gexiang, et al. Artificial Compound Eye: A Survey of the State-of-the-art[J]. Artificial Intelligence Review (S0269-2821), 2017, 48(4): 573-603.
[3]	Liu Yan, Shi Lifang, Shi Ruiying, et al. An Artificial Compound Eye System for Large Field Imaging[C]//Optoelectronic Imaging and Multimedia Technology II.Beijing: SPIE, 2012: 8558.
[4]	Qiu Weichao, Zhong Fangwei, Zhang Yi, et al. UnrealCV:Virtual Worlds for Computer Vision[C]// 25th ACM International Conference on Multimedia. New York:Association for Computing Machinery, 2017: 23-27.
[5]	Pollok Thomas, Junglas Lorenz, Ruf Boitumelo, et al. UnrealGT: Using Unreal Engine to Generate Ground Truth Datasets[M]. Switzerland: Springer International Publishing, 2019: 670-682.
[6]	Shah Shital, Dey Debadeepta, Lovett Chris, et al. AirSim: High-fidelity Visual and Physical Simulation for Autonomous Vehicles[M]. Switzerland: Springer International Publishing, 2017: 621-635.
[7]	Matthias Müller, Vincent Casser, Jean Lahoud, et al. Sim4cv: A Photo-realistic Simulator for Computer Vision Applications[J]. International Journal of Computer Vision (S0920-5691), 2018, 126: 902-919.
[8]	Venkataraman Kartik, Lelescu Dan, Duparré JJacques, et al. Picam: An Ultra-thin High Performance Monolithic Camera Array[J]. ACM Trans. on Graphics (S0730-0301), 2013, 32(6): 166.1-166.13.
[9]	Wilburn Bennett, Joshi Neel, Vaish Vaibhav, et al. High Performance Imaging Using Large Camera Arrays[J].ACM Trans. Graph (S0730-0301), 2005, 24(3): 765-776.
[10]	于晓丹, 张远杰, 王元元, 等. 小型无人机载大视场复眼相机光学系统设计[J]. 光子学报, 2019, 48(7): 17-24.
	Yu Xiaodan, Zhang Yuanjie, Wang Yuanyuan, et al. Optical Design of A Compound Eye Camera with a Large Field of View for Unmanned Aerial Vehicles[J]. Acta Photonica Sinica, 2019, 48(7): 17-24.
[11]	Afshari Hossein, Akin Abdulkadir, Popovic Vladan, et al. Real-time FPGA Implementation of Linear Blending Vision Reconstruction Algorithm Using a Spherical Light Field Camera[C]// IEEE Workshop on Signal Processing Systems. Quebec City, Canada: IEEE, 2012: 49-54.
[12]	Shi Chengyong, Wang Yuanyuan, Liu Chenyang, et al. SCECam: A Spherical Compound Eye Camera for Fast Location and Recognition of Objects at a Large Field of View[J]. Optics Express (S1094-4087), 2017, 25(26): 32333-32345.
[13]	Deng Zefang, Chen Feng, Yang Qing, et al. Dragonfly-Eye-Inspired Artificial Compound Eyes with Sophisticated Imaging[J]. Advanced Functional Materials (S1616-301X), 2016, 26(12): 1995-2001.
[14]	Song Youngmin, Xie Yizhu, Malyarchuk Viktor, et al. Digital Cameras with Designs Inspired by the Arthropod Eye[J]. Nature (S1476-4687), 2013, 497(7447): 95-99.
[15]	Leitel Robert, Brückner Andreas, Buß Wolfgang, et al. Curved Artificial Compound-eyes for Autonomous Navigation[C]// Spie Photonics Europe. Brussels, Belgium:International Society for Optics and Photonics, 2014.
[16]	Zarrad Anis. Game Engine Solutions[M/OL]. London: Intech, 2018.[2021-07-02]. .

类型	单个子眼的参数
平面排布	f、d、N_u、N_v、∆X、∆Y
球面多圈排布	f、d、N_u、N_v、θ、φ、R
球面多列排布	f、d、N_u、N_v、φ、θ、R
柱面排布	f、d、N_u、N_v、φ、∆Y、R

航空器	键位
固定翼	加减速：[]、俯仰：SW、滚转：AD、偏航：QE、收放着陆轮：回车、观察视角：方向键
四旋翼	升降：[]、倾斜：ASDW、偏航：QE、观察视角：方向键
自由视角	前后移动：WS、左右移动：AD、上下移动：EQ、加速：Shift、观察视角：方向键/鼠标

名称	内容
显卡	Nvidia RTX 2070 SUPER
CPU	Intel Core i7-9700K
硬盘	固态1TB
内存	8 GB
操作系统	Windows 7

参数	数值
子眼数量(个)	水平：3、垂直：3
方位夹角/(°)	30
俯仰夹角/(°)	30
球面半径/mm	100
子眼焦距/mm	20
子眼传感器宽度/mm	20
子眼分辨率	512×512

序号	光心坐标(X,Y,Z)	光轴向量(X,Y,Z)
0	–2 547.182,18 281.252,362.852	–0.983,–0.178,–0.046
1	–2 547.179,18 281.296,362.845	–0.957,0.264,–0.116
2	–2 547.159,18 281.335,362.852	–0.752,0.657,–0.047
3	–2 547.164,18 281.240,362.805	–0.803,–0.298,–0.516
4	–2 547.161,18 281.291,362.797	–0.774,0.212,–0.597
5	–2 547.137,18 281.336,362.805	–0.537,0.666,–0.518
6	–2 547.124,18 281.236,362.772	–0.408,–0.338,–0.848
7	–2 547.122,18 281.280,362.765	–0.382,0.104,–0.918
8	–2 547.101,18 281.319,362.772	–0.177,0.497,–0.850