混沌时间序列的高斯过程混合模型预测

doi:10.16182/j.issn1004731x.joss.18-0543

系统仿真学报 ›› 2019, Vol. 31 ›› Issue (7): 1387-1396.doi: 10.16182/j.issn1004731x.joss.18-0543

混沌时间序列的高斯过程混合模型预测

冯振杰¹, 樊煜²

1. 安阳师范学院计算机与信息工程学院,河南安阳 455000;
2. 陕西省渭南市气象局, 陕西渭南 714000

收稿日期:2018-08-08 修回日期:2018-12-24 发布日期:2019-12-12
作者简介:冯振杰(1981-),男,河南安阳,博士生,讲师,研究方向为无线通信技术、多维信号处理、机器学习等。
基金资助:
河南省高等学校重点科研项目(17A510007)

Chaotic Time Series Prediction Based on Gaussian Processes Mixture

Feng Zhenjie¹, Fan Yu²

1. School of Computer and Information Engineering, Anyang Normal University, Anyang 455000, China;
2. Weinan Meteorological Bureau, Weinan 714000, China

Received:2018-08-08 Revised:2018-12-24 Published:2019-12-12

摘要/Abstract

摘要： 高斯过程混合(Gaussian Processes Mixture,GPM)模型现有的学习算法如马尔科夫链蒙特卡洛法、变分法或留一法等,计算复杂度偏高,提出一种隐变量后验硬划分迭代学习算法,简化模型的学习过程,基于该算法将GPM模型用于混沌时间序列预测,并讨论嵌入维、时间延迟、学习样本和测试样本数目等参数对预测性能的影响。实验结果表明,GPM模型预测精度高于支持向量机(Support Vector Machine,SVM)、高斯过程(Gaussian Process,GP)和径向基(Radical Basis Function,RBF)网络,学习速度介于RBF网络、GP和SVM之间。

关键词: 高斯过程混合模型, 混沌时间序列, 预测, 机器学习

Abstract: Aiming at the problem that the existing learning algorithms of Gaussian processes mixture (GPM) model, such as Markov Chain Monte Carlo (MCMC), variation or leave one out, have high computational complexity, a hidden variables posterior hard-cut iterative training algorithm is proposed, which simplifies the training process of the model. The GPM model based on the proposed algorithm is applied to chaotic time series prediction. The effects of embedding dimension, time delay, learning sample number, and testing sample numbers on predictive ability are discussed. It is demonstrated by the experimental results that the prediction of the GPM model is more accurate than SVM, GP and RBF network, and the training speed of GPM model falls in between RBF network, GP model, and SVM.

Key words: Gaussian processes mixtures model, chaotic time series, prediction, machine learning

中图分类号:

TM714

冯振杰, 樊煜. 混沌时间序列的高斯过程混合模型预测[J]. 系统仿真学报, 2019, 31(7): 1387-1396.

Feng Zhenjie, Fan Yu. Chaotic Time Series Prediction Based on Gaussian Processes Mixture[J]. Journal of System Simulation, 2019, 31(7): 1387-1396.

参考文献

[1] Wang W X, Lai Y C, Grebogi C.Data based identification and prediction of nonlinear and complex dynamical systems[J]. Physics Reports (S0370-1573), 2016, 644(7): 1-76.
[2] 崔万照, 朱长纯, 保文星, 等. 混沌时间序列的支持向量机预测[J]. 物理学报, 2004, 53(10): 3303-3310.
Cui Wanzhao, Zhu Changchun, Bao Wenxing, et al.Prediction of the chaotic time series using support vector machines[J]. Acta Physica Sinica, 2004, 53(10): 3303-3310.
[3] Sun J C, Zhou Y T, Luo J G.Prediction of chaotic systems with multidimensional recurrent least squares support vector machines[J]. Chinese Physics (S1674-1056), 2006, 15(6): 1208-1215.
[4] Sun J, Zheng C, Zhou Y, et al.Nonlinear noise reduction of chaotic time series based on multidimensional recurrent LS-SVM[J]. Neurocomputing (S0925-2312), 2008, 71(16): 3675-3679.
[5] 唐舟进, 任峰, 彭涛, 等. 基于迭代误差补偿的混沌时间序列最小二乘支持向量机预测算法[J]. 物理学报, 2014, 63(5): 050505.
Tang Zhoujin, Ren Feng, Peng Tao, et al.A least square support vector machine prediction algorithm for chaotic time series based on the iterative error correction[J]. Acta Physica Sinica, 2014, 63(5): 050505.
[6] 田中大, 高宪文, 石彤. 用于混沌时间序列预测的组合核函数最小二乘支持向量机[J]. 物理学报, 2014, 63(16): 160508.
Tian Zhongda, Gao Xianwen, Shi Tong.Combination kernel function least squares supp ort vector machine for chaotic time series prediction[J]. Acta Physica Sinica, 2014, 63(16): 160508.
[7] 叶美盈, 汪晓东, 张浩然. 基于在线最小二乘支持向量机的混沌时间序列预测[J]. 物理学报, 2005, 54(6): 2568-2573.
Ye Meiying, Wang Xiaodong, Zhang Haoran.Chaotic time series forecasting using online least squares support vector machine regression[J]. Acta Physica Sinica, 2005, 54(6): 2568-2573.
[8] Arash M, Majid A.Developing a local least-squares support vector machines-based neuro-fuzzy model for nonlinear and chaotic time series prediction[J]. IEEE Transactions on Neural Networks and Learning Systems (S2162-237X), 2013, 24(2): 207-218.
[9] Shi Z W, Han M.Support vector echo-state machine for chaotic time-series prediction[J]. IEEE Transactions on Neural Networks (S1045-9227), 2007, 18(2): 359-372.
[10] Li S, Luo Y, Zhang M R.Prediction method for chaotic time series of optimized BP neural network based on genetic algorithm[J]. Computer Engineering and Applications (S1002-8331), 2011, 47(29): 52-55.
[11] 宋彤, 李菡. 基于小波回声状态网络的混沌时间序列预测[J]. 物理学报, 2012, 61(8): 080506.
Song Tong, Li Han.Chaotic time series prediction based on wavelet echo state network[J]. Acta Physica Sinica, 2012, 61(8): 080506.
[12] Zhang J, Chung S H, Lo W L.Chaotic Time Series Prediction Using a Neuro-Fuzzy System with Time-Delay Coordinates[J]. IEEE Transactions on Knowledge and Data Engineering (S1041-4347), 2008, 20(7): 956-964.
[13] Yin L S, He Y G, Dong X P, et al.Adaptive chaotic prediction algorithm of RBF neural network filtering model based on phase space reconstruction[J]. Journal of Computers (S1796-203X), 2013, 8(6): 1449-1455.
[14] 李松, 刘力军, 刘颖鹏. 改进PSO优化BP神经网络的混沌时间序列预测[J]. 计算机工程与应用, 2013, 49(6): 245-248.
Li Song, Liu Lijun, Liu Yingpeng.Prediction for chaotic time series of optimized BP neural network based on modified PSO[J]. Computer Engineering and Applications, 2013, 49(6): 245-248.
[15] Li S, Zhao H, Ru Z, et al.Probabilistic back analysis based on Bayesian and multi-output support vector machine for a high cut rock slope[J]. Engineering Geology (S0013-7952), 2016, 203(3): 178-190.
[16] Rasmussen C E, Nickisch H.Gaussian Processes for Machine Learning (GPML) Toolbox[J]. Journal of Machine Learning Research (S1532-4435), 2010, 11(6): 3011-3015.
[17] 李军, 张友鹏. 基于高斯过程的混沌时间序列单步与多步预测[J]. 物理学报, 2011, 60(7): 070513.
Li Jun, Zhang Youpeng.Single-step and multiple-step prediction of chaotic time series using Gaussian process model[J]. Acta Physica Sinica, 2011, 60(7): 070513.
[18] Zhou Y T, Zhang T Y, Sun J C.Multi-scale Gaussian processes: a novel model for chaotic time series prediction[J]. Chinese Physics Letters (S0256-307X), 2007, 24(1): 42-45.
[19] Zhou Y T, Zhang T Y, Li X H.Prediction of chaotic time series based on multi-scale Gaussian processes[J]. Lecture Notes in Computer Science (S0302-9743), 2006, 4224(9): 183-190.
[20] Chen Z, Ma J, Zhou Y.A Precise Hard-Cut EM Algorithm for Mixtures of Gaussian Processes[C]. International Conference on Intelligent Computing. Cham: Springer, 2014: 68-75.

混沌时间序列的高斯过程混合模型预测

Chaotic Time Series Prediction Based on Gaussian Processes Mixture

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	何俊, 洪孙焱, 周义方, 申时凯, 邹目权. 基于HMM的多维数据下扶贫对象状态预测[J]. 系统仿真学报, 2022, 34(5): 1118-1126.
[2]	吴向平, 平力俊, 徐懂事. 结合社交媒体数据的城市交通事件可视分析方法[J]. 系统仿真学报, 2022, 34(5): 1140-1151.
[3]	孙晓安, 栾小丽, 刘飞. 基于智能优化灰色模型的电子固废预测[J]. 系统仿真学报, 2022, 34(3): 536-542.
[4]	白燕, 武璐璐, 贺引娥, 王玉英. 基于动态温度调控的空调系统能耗预测[J]. 系统仿真学报, 2022, 34(2): 366-375.
[5]	魏腾飞, 潘庭龙. 基于改进PSO优化LSTM网络的短期电力负荷预测[J]. 系统仿真学报, 2021, 33(8): 1866-1874.
[6]	潘红光, 高磊, 米文毓. 基于改进宏观交通流模型的MPC算法设计[J]. 系统仿真学报, 2021, 33(8): 1875-1881.
[7]	路雪鹏, 尚娇, 赵俊辉, 吕露露, 周丽. 基于系统动力学的新冠病毒传播过程预测[J]. 系统仿真学报, 2021, 33(7): 1713-1721.
[8]	位晶晶, 刘勤明, 叶春明, 李冠林. 基于GA-SVR的小样本数据缺失下的设备故障诊断[J]. 系统仿真学报, 2021, 33(6): 1342-1349.
[9]	冷姚, 赵树恩. 智能车辆横向轨迹跟踪的显式模型预测控制方法[J]. 系统仿真学报, 2021, 33(5): 1177-1187.
[10]	张坤平, 郝琳. 基于模型预测的微电网频率协调控制策略[J]. 系统仿真学报, 2021, 33(3): 581-590.
[11]	张琪, 曾俊杰, 许凯, 秦龙, 尹全军. 基于机器学习的计算机生成兵力行为建模研究综述[J]. 系统仿真学报, 2021, 33(2): 280-287.
[12]	毕振波, 张世友, 杨花, 吴远红. 基于浅层机器学习的视频监控船舶检测综述[J]. 系统仿真学报, 2021, 33(12): 2792-2807.
[13]	董海, 高秀秀, 魏铭琦. 基于ACS-DBN的电弧增材制造焊道尺寸预测[J]. 系统仿真学报, 2021, 33(12): 2828-2837.
[14]	李晓赫, 吴建平, 彭德品. 城轨站点高峰小时客流预测控制方法[J]. 系统仿真学报, 2021, 33(12): 2952-2958.
[15]	刘兴, 王艳, 纪志成. 基于随机森林的风电功率短期预测方法[J]. 系统仿真学报, 2021, 33(11): 2606-2614.