High-dimensional data hiding pattern mining based on topology data analysis

doi:10.16182/j.issn1004731x.joss.19-0401

Abstract

Abstract: Aiming at the limitation of traditional data analysis methods to find hidden patterns between high-dimensional complex data, a method of high-dimensional data hiding pattern mining based on topological data analysis is proposed. By extracting the characteristics of complex high-dimensional data, the relationship between its shapes and samples is analyzed. To get the dataset hidden mode, the topological data analysis is used to verify the gender recognition of high-dimensional dataset-voice.. At the same time, the relationship between the dataset data subgroups and related data subgroups is visually analyzed. The results show that the implicit relationship and pattern between data subgroups can be found by the proposed method, which cannot be found by traditional methods and it is more detailed and effective than traditional methods. The results also verify the power and effectiveness of the proposed method for high-dimensional data hiding mode mining.

Key words: topological data analysis, hidden pattern mining, high dimensional data

CLC Number:

TP391.9

Liu Bolong, Li Zhe. High-dimensional data hiding pattern mining based on topology data analysis[J]. Journal of System Simulation, 2019, 31(9): 1755-1762.

References

[1] 海沫. 大数据聚类算法综述[J]. 计算机科学, 2016, 43(增1): 380-383.
Hai Mo.Overview of Big Data Clustering Algorithms[J]. Computer Science, 2016, 43(S1): 380-383.
[2] 王光宏, 蒋平. 数据挖掘综述[J]. 同济大学学报(自然科学版), 2004(2): 246-252.
Wang Guanghong, Jiang Ping.A Survey of Data Mining[J]. Journal of Tongji University (Natural Science), 2004(2): 246-252.
[3] 孙喜利. 高维数据的降维及聚类方法研究[D]. 兰州: 兰州大学, 2016.
Sun Xili.Research on Dimensionality Reduction and Clustering Method of High Dimensional Data[D]. Lanzhou: Lanzhou University, 2016.
[4] Treshansky A, Mcgraw R M.Overview of clustering algorithms[J]. Proceedings of SPIE - The International Society for Optical Engineering, 2001, 4367: 41-51.
[5] Medina P S, Doerge R W. Statistical Methods in Topological Data Analysis for Complex, High-Dimensional Data[J]. arXiv:1607.05150 [stat] (S2331-8422), 2016. https://arxiv.org/abs/1607.05150.
[6] Lum P Y, Singh G, Lehman A, et al.Extracting insights from the shape of complex data using topology[J]. Scientific Reports (S2045-2322), 2013, 3(1): 1236
[7] Khasawneh F A, Munch E, Perea J A.Chatter Classification in Turning Using Machine Learning and Topological Data Analysis[J]. IFAC-Papers On Line (S2405-8963), 2018, 51(14): 195-200.
[8] 马昱欣, 曹震东, 陈为. 可视化驱动的交互式数据挖掘方法综述[J]. 计算机辅助设计与图形学学报, 2016, 28(1): 1-8.
Ma Yuxin, Cao Zhendong, Chen Wei.A Review of Visualized Driven Interactive Data Mining Methods[J]. Journal of Computer-Aided Design & Computer Graphics, 2016, 28(1): 1-8.
[9] Carlsson G.Topology and data[J]. Bulletin of the American Mathematical Society (S0273-0979), 2009, 46(2): 255-308.
[10] Liu S, Maljovec D, Wang B, et al.Visualizing High-Dimensional Data: Advances in the Past Decade[J]. IEEE Transactions on Visualization and Computer Graphics (S1077-2626), 2017, 23(3): 1249-1268.
[11] Chazal F, Michel B. An introduction to Topological Data Analysis: fundamental and practical aspects for data scientists[J]. arXiv:1710.04019 [cs, math, stat] (S2331-8422), 2017. https://arxiv.org/abs/1710.04019.
[12] Wasserman L. Topological Data Analysis[J]. arXiv:1609.08227 [stat] (S2331-8422), 2016. https://doi.org/10.1038/s41566-018-0148-x.
[13] Dey T K, Memoli f, Wang Y. Mutiscale MAPPER: A Framework for Topological Summarization of Data and Maps[J]. arXiv:1504.03763 [cs, math] (S2331-8422), 2015. https://arxiv.org/abs/1504.03763.
[14] Singh G, Mémoli F, Carlsson G E. Topological methods for the analysis of high dimensional data sets and 3d object recognition[C]// SPBG.2007: 91-100. https://www.ayasdi.com/wp-content/uploads/2015/02/Topological_Methods_for_the_Analysis_of_High_Dimensional_Data_Sets_and_3D_Object_Recognition.pdf.

[1]	Zhijie Li, Haoqi Shi, Changhua Li, Jie Zhang. Image Center Layout Optimization Method Based on Improved Genetic Algorithm [J]. Journal of System Simulation, 2022, 34(6): 1173-1184.
[2]	Bin Chen, Yue Liu, Yalei Yang. Airport Flight Transit Support Time Collaborative Planning Modeling Based on STN [J]. Journal of System Simulation, 2022, 34(6): 1196-1207.
[3]	Kai Yang, Chunyi Chen, Xiaojuan Hu, Haiyang Yu. Denoising Algorithm Based on Multi-feature Non-local Mean Filtering for Monte Carlo Rendered Images [J]. Journal of System Simulation, 2022, 34(6): 1259-1266.
[4]	Qi Chen, Haoyang Cui. Visual inspection model of UAV cluster based on improved pigeon flock hierarchy [J]. Journal of System Simulation, 2022, 34(6): 1275-1285.
[5]	Muqing Wang, Lei Zhang, Xiumin Fan, Xiaomeng Luo, Wenmin Zhu. Simulation Method of Virtual Human Pose Optimization Based On VR Peripherals [J]. Journal of System Simulation, 2022, 34(6): 1296-1303.
[6]	Cheng Lu, Xuesheng Jin. Design of Interactive Simulated Water Gun Fire Fighting Training System Based on Steam VR [J]. Journal of System Simulation, 2022, 34(6): 1312-1319.
[7]	Hongnai Gao, Lijiang Fu, Qian Xia, Ya Guo. Application of Observability in Performance Evaluation of Photosynthesis Model [J]. Journal of System Simulation, 2022, 34(6): 1330-1342.
[8]	Lingjia Ni, Xiaoxia Huang, Hongga Li, Zibo Zhang. Research on Fire Emergency Evacuation Simulation Based on Cooperative Deep Reinforcement Learning [J]. Journal of System Simulation, 2022, 34(6): 1353-1366.
[9]	Dun Meng, Zhuo Hu, Huajun Zhang. Simulation of Multi-layer Ship Evacuation System Based on Improved A* Algorithm [J]. Journal of System Simulation, 2022, 34(6): 1375-1382.
[10]	Yufei Guo, Kang Zhao, Yongqing Hai. Triangular Mesh Boolean Operation Method for Finite Element Analysis [J]. Journal of System Simulation, 2022, 34(5): 1003-1014.
[11]	Tong Wu, Qinghui Wang, Zhijia Xu. Study on the Scale Characteristics of Permeability of TPMS Porous Materials [J]. Journal of System Simulation, 2022, 34(5): 1015-1024.
[12]	Yangsheng Jiang, Sichen Wang, Kuan Gao, Meng Liu, Zhihong Yao. Cellular Automata Model of Mixed Traffic Flow Composed of Intelligent Connected Vehicles’ Platoon [J]. Journal of System Simulation, 2022, 34(5): 1025-1032.
[13]	Jiangtao Liang, Huiqin Wang. Study on Building Fire Evacuation Path Planning Based on Improved Ant Colony Algorithm [J]. Journal of System Simulation, 2022, 34(5): 1044-1053.
[14]	Qiwen Zhang, Bin Zhang. Teaching-Learning-Based Optimization Algorithm for Permutation Flowshop Scheduling [J]. Journal of System Simulation, 2022, 34(5): 1054-1063.
[15]	Genshang Xing, Fang Lu, Shushan Li, Dingti Luo. Supply Chain Delivery Model and Simulation Based on Product Experience [J]. Journal of System Simulation, 2022, 34(5): 1064-1075.