An ARMA Type Pi-Sigma Artificial Neural Network for Nonlinear Time Series Forecasting

Akdeniz, Esra; Egrioglu, Erol; Bas, Eren; Yolcu, Ufuk

doi:10.1515/jaiscr-2018-0009

Abstract

Real-life time series have complex and non-linear structures. Artificial Neural Networks have been frequently used in the literature to analyze non-linear time series. High order artificial neural networks, in view of other artificial neural network types, are more adaptable to the data because of their expandable model order. In this paper, a new recurrent architecture for Pi-Sigma artificial neural networks is proposed. A learning algorithm based on particle swarm optimization is also used as a tool for the training of the proposed neural network. The proposed new high order artificial neural network is applied to three real life time series data and also a simulation study is performed for Istanbul Stock Exchange data set.

References

[1] R.N. Yadav, P.K. Kalra, J. John, Time series prediction with single multiplicative neuron model, Applied Soft Computing, 7, 2007, 1157-1163.10.1016/j.asoc.2006.01.003
Search in Google Scholar Back to article
[2] E. Egrioglu, C.H. Aladag, U. Yolcu, and E. Bas, Recurrent multiplicative neuron model artificial neural network for non-linear time series forecasting, Neural Processing Letters 41(2), 2015, 249-258.10.1007/s11063-014-9342-0
Search in Google Scholar Back to article
[3] O. Gundogdu, E. Egrioglu, C.H. Aladag, and U. Yolcu, Multiplicative neuron model artificial neural network based on gauss activation function, Neural Computing and Applications 27(4), 2015, 927-93510.1007/s00521-015-1908-x
Search in Google Scholar Back to article
[4] D.E. Rumelhart, and J.L. Mcclelland, Parallel distributed processing: explorations in the microstructure of cognition, Cambridge (Britian): MIT Press, 1986.10.7551/mitpress/5236.001.0001
Search in Google Scholar Back to article
[5] C.L. Giles, and T. Maxwell, Learning, invariance, and generalization in a high-order neural network, Appl Opt, 26(23), 1978, 4972–8.10.1364/AO.26.00497220523475
Search in Google Scholar Back to article
[6] R. Durbin, and D.E. Rumelhart, Product units: a computationally powerful and biologically plausible extension to back propagation networks, Neural Computation, 1, 1989:133–42.10.1162/neco.1989.1.1.133
Search in Google Scholar Back to article
[7] Y. Shin, and J. Gosh, The Pi-sigma Network: An efficient higher-order neural network for pattern classification and function approximation. In Proceedings of the International Joint Conference on Neural Networks, 1991.
Search in Google Scholar Back to article
[8] R. Ghazali. A. Husaini, L.H. Ismail, T. Herawan, and Y.M. Hassim, The performance of a recurrent HONN for temperature time series prediction, 2014 International Joint Conference on Neural Networks (IJCNN), July 6-11, Proceeding Book, page 518-524, Beijing, China, 2014.10.1109/IJCNN.2014.6889789
Search in Google Scholar Back to article
[9] R. Ghazali. A. Husaini, and W. El-Deredy, Application of ridge polynomial neural networks to financial time series prediction. In: 2006 International joint conference on neural networks; July, 16–21, 2006, 913–20.10.1109/IJCNN.2006.246783
Search in Google Scholar Back to article
[10] R. Ghazali, A.J. Hussain, P. Liatsis, and H. Tawfik, The application of ridge polynomial neural network to multi-step ahead financial time series prediction, Neural Computing & Applications, 17(3), 2008, 311–323.10.1007/s00521-007-0132-8
Search in Google Scholar Back to article
[11] H. Tawfik, and P. Liatsis, Prediction of non-linear time-series using higher-order neural networks, Proceeding IWSSIP’97 Conference, Poznan, Poland, 1977.
Search in Google Scholar Back to article
[12] N. Yong, and D. Wei, A hybrid genetic learning algorithm for Pi– sigma neural network and the analysis of its convergence, In: IEEE fourth international conference on natural computation, 19–23, 2008
Search in Google Scholar Back to article
[13] J. Nayak, B. Naik, and H.S. Behera, A hybrid PSO-GA based Pi sigma neural network (PSNN) with standard back propagation gradient descent learning for classification. International Conference on Control, Instrumentation, Communication and Computational Technologies, ICCICCT 2014, art. no. 6993082, 878-885, 2014b.10.1109/ICCICCT.2014.6993082
Search in Google Scholar Back to article
[14] J. Nayak, B. Naik, and H.S. Behera, and A. Abraham, Particle swarm optimization based higher order neural network for classification, Smart Innovation, Systems and Technologies, 31, 2015, 401-414.10.1007/978-81-322-2205-7_38
Search in Google Scholar Back to article
[15] L. Chien-Kuo, Memory-based Sigma–Pi–Sigma neural network, IEEE SMC, TP1F5; 2002, 112–8.
Search in Google Scholar Back to article
[16] A.J. Hussain, and P. Liatsis, Recurrent Pi–Sigma networks for DPCM image coding, Neurocomputing, 55, 2002, 363–82.10.1016/S0925-2312(02)00629-X
Search in Google Scholar Back to article
[17] J. Nayak, D.P. Kanungo, B. Naik, and H.S. Behera, A higher order evolutionary Jordan Pi-sigma neural network with gradient descent learning for classification, 2014 International Conference on High Performance Computing and Applications, ICHPCA 2014, Article number 7045328.10.1109/ICHPCA.2014.7045328
Search in Google Scholar Back to article
[18] J. Kennedy, R. Eberhart, Particle swarm optimization, In Proceedings of IEEE International Conference on Neural Networks, Piscataway, NJ, USA, IEEE Press., 1995, 1942–1948.
Search in Google Scholar Back to article
[19] C.H. Aladag, U. Yolcu, and E. Egrioglu, A new multiplicative seasonal neural network model based on particle swarm optimization, Neural Processing Letters 37(3), 2013, 251-262.10.1007/s11063-012-9244-y
Open DOI Search in Google Scholar Back to article
[20] G. Janacek, Practical time series. Oxford University Press Inc., New York, 156, 2001.
Search in Google Scholar Back to article
[21] U. Yolcu, E. Egrioglu, C.H. Aladag, A new linear & nonlinear artificial neural network model for time series forecasting, Decision Support Systems, 2013, 1340–1347.10.1016/j.dss.2012.12.006
Open DOI Search in Google Scholar Back to article
[22] J.L. Elman, Finding structure in time, Cognitive Science, 14 (2), 1990, 179–211.10.1207/s15516709cog1402_1
Open DOI Search in Google Scholar Back to article

An ARMA Type Pi-Sigma Artificial Neural Network for Nonlinear Time Series Forecasting

Abstract

Paradigm

My account