High-dimensional data hiding pattern mining based on topology data analysis

doi:10.16182/j.issn1004731x.joss.19-0401

Abstract

Abstract: Aiming at the limitation of traditional data analysis methods to find hidden patterns between high-dimensional complex data, a method of high-dimensional data hiding pattern mining based on topological data analysis is proposed. By extracting the characteristics of complex high-dimensional data, the relationship between its shapes and samples is analyzed. To get the dataset hidden mode, the topological data analysis is used to verify the gender recognition of high-dimensional dataset-voice.. At the same time, the relationship between the dataset data subgroups and related data subgroups is visually analyzed. The results show that the implicit relationship and pattern between data subgroups can be found by the proposed method, which cannot be found by traditional methods and it is more detailed and effective than traditional methods. The results also verify the power and effectiveness of the proposed method for high-dimensional data hiding mode mining.

Key words: topological data analysis, hidden pattern mining, high dimensional data

CLC Number:

TP391.9

Liu Bolong, Li Zhe. High-dimensional data hiding pattern mining based on topology data analysis[J]. Journal of System Simulation, 2019, 31(9): 1755-1762.

References

[1] 海沫. 大数据聚类算法综述[J]. 计算机科学, 2016, 43(增1): 380-383.
Hai Mo.Overview of Big Data Clustering Algorithms[J]. Computer Science, 2016, 43(S1): 380-383.
[2] 王光宏, 蒋平. 数据挖掘综述[J]. 同济大学学报(自然科学版), 2004(2): 246-252.
Wang Guanghong, Jiang Ping.A Survey of Data Mining[J]. Journal of Tongji University (Natural Science), 2004(2): 246-252.
[3] 孙喜利. 高维数据的降维及聚类方法研究[D]. 兰州: 兰州大学, 2016.
Sun Xili.Research on Dimensionality Reduction and Clustering Method of High Dimensional Data[D]. Lanzhou: Lanzhou University, 2016.
[4] Treshansky A, Mcgraw R M.Overview of clustering algorithms[J]. Proceedings of SPIE - The International Society for Optical Engineering, 2001, 4367: 41-51.
[5] Medina P S, Doerge R W. Statistical Methods in Topological Data Analysis for Complex, High-Dimensional Data[J]. arXiv:1607.05150 [stat] (S2331-8422), 2016. https://arxiv.org/abs/1607.05150.
[6] Lum P Y, Singh G, Lehman A, et al.Extracting insights from the shape of complex data using topology[J]. Scientific Reports (S2045-2322), 2013, 3(1): 1236
[7] Khasawneh F A, Munch E, Perea J A.Chatter Classification in Turning Using Machine Learning and Topological Data Analysis[J]. IFAC-Papers On Line (S2405-8963), 2018, 51(14): 195-200.
[8] 马昱欣, 曹震东, 陈为. 可视化驱动的交互式数据挖掘方法综述[J]. 计算机辅助设计与图形学学报, 2016, 28(1): 1-8.
Ma Yuxin, Cao Zhendong, Chen Wei.A Review of Visualized Driven Interactive Data Mining Methods[J]. Journal of Computer-Aided Design & Computer Graphics, 2016, 28(1): 1-8.
[9] Carlsson G.Topology and data[J]. Bulletin of the American Mathematical Society (S0273-0979), 2009, 46(2): 255-308.
[10] Liu S, Maljovec D, Wang B, et al.Visualizing High-Dimensional Data: Advances in the Past Decade[J]. IEEE Transactions on Visualization and Computer Graphics (S1077-2626), 2017, 23(3): 1249-1268.
[11] Chazal F, Michel B. An introduction to Topological Data Analysis: fundamental and practical aspects for data scientists[J]. arXiv:1710.04019 [cs, math, stat] (S2331-8422), 2017. https://arxiv.org/abs/1710.04019.
[12] Wasserman L. Topological Data Analysis[J]. arXiv:1609.08227 [stat] (S2331-8422), 2016. https://doi.org/10.1038/s41566-018-0148-x.
[13] Dey T K, Memoli f, Wang Y. Mutiscale MAPPER: A Framework for Topological Summarization of Data and Maps[J]. arXiv:1504.03763 [cs, math] (S2331-8422), 2015. https://arxiv.org/abs/1504.03763.
[14] Singh G, Mémoli F, Carlsson G E. Topological methods for the analysis of high dimensional data sets and 3d object recognition[C]// SPBG.2007: 91-100. https://www.ayasdi.com/wp-content/uploads/2015/02/Topological_Methods_for_the_Analysis_of_High_Dimensional_Data_Sets_and_3D_Object_Recognition.pdf.

[1]	Huang Tao, Zhang Zhi, Ding Yujie, Chen Yanbo, Wang Jing, Zhang Wenqian. Robust Emergency Dispatch Method Considering Dynamic Frequency Security and N-k Contingency [J]. Journal of System Simulation, 2025, 37(12): 2981-2993.
[2]	Zhang Runzhao, Chen Yanbo, Huang Tao, Tian Haoxin, Qiang Tuben, Zhang Zhi. Scheduling Method for Virtual Power Plants Based on Analysis and Forecasting of Heterogeneous Load Characteristics [J]. Journal of System Simulation, 2025, 37(12): 2994-3006.
[3]	Yu Xiangxing, Zhao Yandong, Zhang Baolin. Vibration Control of Offshore Wind Turbine Towers Based on Eddy Current Nonlinear Energy Sink [J]. Journal of System Simulation, 2025, 37(12): 3007-3017.
[4]	Li Bin, Wang Yuchuo. Fault Diagnosis Method for Photovoltaic Systems Based on Multi-strategy Fusion [J]. Journal of System Simulation, 2025, 37(12): 3018-3032.
[5]	Li Xiaobin, Hu Bing, Yin Chao, Li Bo, Ma Jun. Spatiotemporal Graph Convolution-based Demand Forecasting and Simulation Analysis for Automotive Parts Supply Chain [J]. Journal of System Simulation, 2025, 37(12): 3060-3074.
[6]	Peng Yi, Lei Yunkui, Yang Qingqing, Li Hui, Wang Jianming. Improved PID Search Algorithm for UAV Path Planning in Mountainous Environments [J]. Journal of System Simulation, 2025, 37(12): 3075-3086.
[7]	Chen Yi, Qiu Sihang, Zhu Zhengqiu, Ji Yatai, Zhao Yong, Ju Rusheng. A Method of Heuristic Human-LLM Collaborative Source Search [J]. Journal of System Simulation, 2025, 37(12): 3112-3127.
[8]	Suo Jingyi, Lu Baihong, Qu Che. Measurement of Luminous Intensity Distribution for Film and Television LED Light Sources and Its Simulation Research in Game Engines [J]. Journal of System Simulation, 2025, 37(12): 3140-3151.
[9]	Gong Jianxing, Hu Hai, Ren Haihui, Wu Ruixiang. Interoperability Model and Application of Military Training System for Combination of Virtuality and Reality [J]. Journal of System Simulation, 2025, 37(12): 3161-3175.
[10]	Xu Zhixia, Wang Rui, Sun Nan, He Bing, Shen Xiaowei, Zhu Xiaofei. Research on Cooperative Interference Allocation of Jamming Resources Based on Improved Genetic Algorithm [J]. Journal of System Simulation, 2025, 37(12): 3176-3189.
[11]	Liu Xiang, Jin Qiankun. Research on PAC-Bayes-Based A2C Algorithm for Multi-objective Reinforcement Learning [J]. Journal of System Simulation, 2025, 37(12): 3212-3223.
[12]	Yang Lanying, Li Chao, Zou Haifeng, Wan Jiangtao, Zhang Renqiang, Liu Hui, Lu Hong. Robot Path Planning Optimization Based on Fusion of Improved Ant Colony Algorithm and A* Algorithm [J]. Journal of System Simulation, 2025, 37(11): 2956-2965.
[13]	Su Xiaoting, Zhang Xiaowei, Tian Yi, Li Qi, Wang Shuaihao. Research on Time Sequence Design Method of Dynamic Simulation Scene for Starlight Navigation [J]. Journal of System Simulation, 2025, 37(11): 2946-2955.
[14]	Zhang Zhili, Liu Jin, Zhou Zhaofa, Liang Zhe, Zhang Yunhao. Research on Temperature Compensation Technology of Fiber Optic Gyroscope based on ISCSO-BP Neural Network Model [J]. Journal of System Simulation, 2025, 37(11): 2904-2917.
[15]	Chen Jitong, Zhou Jiajia, Wu Di, Jiang Hailong. A USV Path Planning Algorithm under Special Environment Based on TD3-RRT [J]. Journal of System Simulation, 2025, 37(11): 2888-2903.