Examine the Reliability of Econometrics Software: An Empirical Comparison of Time Series Modelling
- 1 Department of Statistics & Computer Science, Faculty of Science, University of Peradeniya, Peradeniya, Sri Lanka
- 2 Department of Economics & Statistics, Faculty of Arts, University of Peradeniya, Peradeniya, Sri Lanka
- 3 Department of Statistics & Computer Science, Faculty of Science, University of Peradeniya, Peradeniya, Sri Lanka
- 4 Department of Statistics & Computer Science, Faculty of Science, University of Peradeniya, Peradeniya, Sri Lanka
Abstract
Researchers must understand that naively relying on the reliability of statistical software packages may result in suboptimal, biased, or erroneous results, which affects applied economic theory and the conclusions and policy recommendations drawn from it. To create confidence in a result, several software packages should be applied to the same estimation problem. This study examines the results of three software packages (EViews, R, and Stata) in the analysis of time-series econometric data. The time-series data analysis which presents the determinants of macroeconomic growth of Sri Lanka from 1978 to 2020 has been used. The study focuses on testing for stationarity, cointegration, and significant relationships among the variables. The Augmented Dickey-Fuller and Phillips Perron tests were employed in this study to test for stationarity, while the Johansen cointegration test was utilized to test for cointegration. The study employs the vector error correction model to assess the short-run and long-term dynamics of the variables in an attempt to determine the relationship between them. Finally, the Granger Causality test is employed in order to examine the linear causation between the concerned variables. The study revealed that the results produced by three software packages for the same dataset and the same lag order vary significantly. This implies that time series econometrics results are sensitive to the software that is used by the researchers while providing different policy implications even for the same dataset. The present study highlights the necessity of further analysis to investigate the impact of software packages in time series analysis of economic scenarios.
- Chen, E.E. and Wojcik, S.P. (2016) A Practical Guide to Big Data Research in Psychology. Psychological Methods, 21, 458-474. https://doi.org/10.1037/met0000111
- Ciftci, S.K., Karadag, E. and Akdal, P. (2014) Instruction of Statistics via Computer-Based Tools: Effects on Statistics’ Anxiety, Attitude, and Achievement. Journal of Educational Computing Research, 50, 119-133. https://doi.org/10.2190/EC.50.1.f
- McCulloch, R S. (2017) Learning Outcomes in a Laboratory Environment vs. Classroom for Statistics Instruction: An Alternative Approach Using Statistical Software. International Journal of Higher Education, 6, 131-142. https://doi.org/10.5430/ijhe.v6n5p131
- Sosa, G.W., Berger, D.E., Saw, A.T. and Mary, J.C. (2011) Effectiveness of Computer-Assisted Instruction in Statistics: A Meta-Analysis. Review of Educational Research, 81, 97-128. https://doi.org/10.3102/0034654310378174
- McCullough, B.D. and Vinod, H.D. (1999) The Numerical Reliability of Econometric Software. Journal of Economic Literature, 37, 633-665. https://doi.org/10.1257/jel.37.2.633
- Altman, M. and McDonald, M.P. (2001) Choosing Reliable Statistical Software. PS: Political Science & Politics, 34, 681-687. https://doi.org/10.1017/S1049096501001093
- McCullough, B.D. and Wilson, B. (2005) On the Accuracy of Statistical Procedures in Microsoft Excel 2003. Computational Statistics & Data Analysis, 49, 1244-1252. https://doi.org/10.1016/j.csda.2004.06.016
- Sawitzki, G. (1994) Report on the Numerical Reliability of Data Analysis Systems. Computational Statistics & Data Analysis, 18, 289-301. https://doi.org/10.1016/0167-9473(94)90177-5
- McCullough, B.D. (1999) Assessing the Reliability of Statistical Software: Part II. The American Statistician, 53, 149-159. https://doi.org/10.1080/00031305.1999.10474450
- McCullough, B.D. (1999) Econometric Software Reliability: EViews, LIMDEP, SHAZAM and TSP. Journal of Applied Econometrics, 14, 191-202. https://doi.org/10.1002/(SICI)1099-1255(199903/04)14:2 3.0.CO;2-K
- McCullough, B.D. and Heiser, D.A. (2008) On the Accuracy of Statistical Procedures in Microsoft Excel 2007. Computational Statistics & Data Analysis, 52, 4570-4578. https://doi.org/10.1016/j.csda.2008.03.004
- L’Ecuyer, P. and Simard, R. (2007) TestU01: AC Library for Empirical Testing of Random Number Generators. ACM Transactions on Mathematical Software (TOMS), 33, Article No. 22. https://doi.org/10.1145/1268776.1268777