To overcome the weaknesses of in-sample model selection, this study adopted out-of-sample model selection approach for selecting models with improved forecasting accuracies and performances. Daily closing share prices were obtained from Diamond Bank and Fidelity Bank as listed in the Nigerian Stock Exchange spanning from January 3, 2006 to December 30, 2016. Thus, a total of 2713 observations were explored and were divided into two portions. The first which ranged from January 3, 2006 to November 24, 2016, comprising 2690 observations, was used for model formulation. The second portion which ranged from November 25, 2016 to December 30, 2016, consisting of 23 observations, was used for out-of-sample forecasting performance evaluation. Combined linear (ARIMA) and Nonlinear (GARCH-type) models were applied on the returns series with respect to normal and student-t distributions. The findings revealed that ARIMA (2,1,1)-EGARCH (1,1)-norm and ARIMA (1,1,0)-EGARCH (1,1)-norm models selected based on minimum predictive errors throughout-of-sample approach outperformed ARIMA (2,1,1)-GARCH (2,0)-std and ARIMA (1,1,0)-EGARCH (1,1)-std model chosen through in-sample approach. Therefore, it could be deduced that out-of-sample model selection approach was suitable for selecting models with improved forecasting accuracies and performances.
KeywordsARIMA ModelGARCH-Type ModelHeteroscedasticityModel SelectionTime Series ForecastingVolatility
Ding, J., Tarokh, V. and Gang, G. (2018) Model Selection Techniques—An Overview. IEEE Signal Processing Magazine, 21, 1-21. http://arXiv:1810.09583v1
Leeb, H. (2008) Evaluation and Selection of Models for Out-of-Sample Prediction when the Sample Size Is Small Relative to the Complexity of the Data-Generating Process. Bernoulli, 14, 661-690. https://doi.org/10.3150/08-BEJ127
Sinharay, S. (2010) An Overview of Statistics in Education. In: Peterson, P., et al., Eds., International Encyclopedia of Education, 3rd Edition, Elsevier Ltd., Amsterdam, 1-11. https://doi.org/10.1016/B978-0-08-044894-7.01719-X
Montgomeny, D.C., Jennings, C.L. and Kulahci, M. (2008) Introduction to Time Series Analysis and Forecasting. John Wiley & Sons, Hoboken, 18-60.
Wei, W.W.S. (2006) Time Series Analysis Univariate and Multivariate Methods. 2nd Edition, Addison Wesley, New York, 33-59.
Akaike, H. (1973) A New Look at the Statistical Model Identification. IEEE Transactions on Automatic Control, 19, 716-723. https://doi.org/10.1109/TAC.1974.1100705
Schwarz, G. (1978) Estimating the Dimension of a Model. Annals of Statistics, 6, 461-464. https://www.jstor.org/stable/2958889 https://doi.org/10.1214/aos/1176344136
Hannan, E. and Quinn, B. (1979) The Determination of the Order of an Auto-Regression. Journal of Royal Statistical Society, Series B, 41, 190-195. https://www.jstor.org/stable/2985032 https://doi.org/10.1111/j.2517-6161.1979.tb01072.x
Zou, H. and Yang, G. (2004) Combining Time Series Models for Forecasting. International Journal of Forecasting, 20, 69-84. https://doi.org/10.1016/S0169-2070(03)00004-9
Box, G.E.P., Jenkins, G.M. and Reinsel, G.C. (2008) Time Series Analysis: Forecasting and Control. 3rd Edition, John Wiley & Sons, Hoboken, 5-22. https://doi.org/10.1002/9781118619193
Bozdogan, H. (2000) Akaike’s Information Criteria and Recent Developments Information Complexity. Journal of Mathematical Psychology, 44, 62-91. https://doi.org/10.1006/jmps.1999.1277
Wasserman, L. (2000) Bayesian Model Selection and Model Averaging. Journal of Mathematical Psychology, 44, 92-107. https://doi.org/10.1006/jmps.1999.1278
Myung, I.J. (2000) The Importance of Complexity in Model Selection. Journal of Mathematical Psychology, 44, 190-204. https://doi.org/10.1006/jmps.1999.1283
Zucchini, W. (2000) An Introduction to Model Selection. Journal of Mathematical Psychology, 44, 41-61. https://doi.org/10.1006/jmps.1999.1276
Pilatowska, M. (2011) Information and Prediction Criteria in Selecting the Forecasting Model. Dynamic Econometric Models, 11, 21-40. https://doi.org/10.12775/DEM.2011.002
Chatfield, C. (2000) Time Series Forecasting. 5th Edition, Chapman and Hall CRC, New York.
Moffat, I.U. and Akpan, E.A. (2014) Time Series Forecasting: A Tool for Out-Sample Model Selection and Evaluation. American Journal of Scientific and Industrial Research, 5, 185-194.
Mitchell, H. and Mokenzie, M.D. (2010) GARCH Model Selection Criteria. Quantitative Finance, 3, 262-284. https://doi.org/10.1088/1469-7688/3/4/303
Brooks, C. and Burke, S.P. (2010) Information Criteria for GARCH Model Selection. The European Journal of Finance, 9, 557-580. https://doi.org/10.1080/1351847021000029188
Degiannakis, S. and Xekalaki, E. (2005) Predictability and Model Selection in the Context of ARCH Models. Journal of Applied Stochastic Models in Business and Industry, 21, 55-82. https://doi.org/10.1002/asmb.551
Bal, C., Demir, S. and Aladag, C.H. (2016) A Comparison of Different Model Selection Criteria for Forecasting EURO/USD Exchange Rates by Feed Forward Neural Network. International Journal of Computing, Communication and Instrumentalism Engineering, 3, 271-275. https://doi.org/10.15242/IJCCIE.U0616010
Psaradakis, Z., Sola, M., Spagnolo, F. and Spagnolo, N. (2009) Selecting Nonlinear Time Series Models Using Information Criteria. Journal of Time Series Analysis, 30, 369-394. https://doi.org/10.1111/j.1467-9892.2009.00614.x
Pena, D. and Rodriguez, J. (2005) Detecting Nonlinearity in Time Series by Model Selection Criteria. International Journal of Forecasting, 21, 731-748. https://doi.org/10.1016/j.ijforecast.2005.04.014
Manzan, S. (2004) Model Selection for Non Linear Time Series. Empirical Economics, 29, 901-920. https://doi.org/10.1007/s00181-004-0207-7
Judd, K. and Mees, A. (1995) On Selecting Models for Nonlinear Time Series. Physica D: Nonlinear Phenomena, 82, 426-444. https://doi.org/10.1016/0167-2789(95)00050-E
Liu, Y. and Enders, W. (2003) Out-of-Sample Forecasts and Nonlinear Model Selection with an Example of the Term Structure of Interest Rates. Southern Economic Journal, 69, 520-540. https://www.jstor.org/stable/1061692 https://doi.org/10.2307/1061692
Gabriel, A.S. (2012) Evaluating the Forecasting Performance of GARCH Models: Evidence from Romania. Precedia-Social and Behavioral Sciences, 62, 1006-1010. https://doi.org/10.1016/j.sbspro.2012.09.171
Akpan, E.A., Lasisi, K.E. and Adamu, A. (2018) Modeling Heteroscedasticity in the Presence of Outliers in Discrete-Time Stochastic Series. Academic Journal of Applied Mathematical Sciences, 4, 61-76.
Akpan, E.A. and Moffat, I.U. (2017) Detection and Modeling of Asymmetric GARCH Effects in a Discrete-Time Series. International Journal of Statistics and Probability, 6, 111-119. https://doi.org/10.5539/ijsp.v6n6p111
Akpan, E.A., Moffat, I.U. and Ekpo, N.B. (2016) Arma-Arch Modeling of the Returns of First Bank of Nigeria. European Scientific Journal, 12, 257-266. https://doi.org/10.19044/esj.2016.v12n18p257
Onwukwe, C.E., Samson, T.K. and Lipcsey, Z. (2014) Modeling and Forecasting Daily Returns Volatility of Nigerian Banks Stocks. European Scientific Journal, 10, 449-467.
Arowolo, W.B. (2013) Predicting Stock Prices Returns Using GARCH Model. International Journal of Engineering and Science, 2, 32-37.
Emenike, K.O. and Friday, A.S. (2012) Modeling Asymmetric Volatility in the Nigerian Stock Exchange. European Journal of Business and Management, 4, 52-59.
Akpan, E.A., Lasisi, K.E., Adamu, A. and Rann, H.B. (2019) Evaluation of Forecasts Performance of ARIMA-GARCH-Type Models in the Light of Outliers. World Scientific News, 119, 68-84.
Engle, R.F. (1982) Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflations. Econometrica, 50, 987-1007. https://doi.org/10.2307/1912773
Francq, C. and Zakoian, J. (2010) GARCH Models: Structure, Statistical Inference and Financial Applications. John Wiley & Sons Ltd., Chichester, 19-220. https://doi.org/10.1002/9780470670057
Tsay, R.S. (2010) Analysis of Financial Time Series. 3rd Edition, John Wiley & Sons Inc., New York, 97-140. https://doi.org/10.1002/9780470644560
Nelson, D.B. (1991) Conditional Heteroscedasticity of Asset Returns. A New Approach. Econometrica, 59, 347-370. https://doi.org/10.2307/2938260
Glosten, L.R., Jagannathan, R. and Runkle, D. (1993) On the Relation between the Expected Values and the Volatility of the Nominal Excess Return on Stocks. Journal of Finance, 48, 1779-1801. https://doi.org/10.1111/j.1540-6261.1993.tb05128.x