Inference in Univariate and Bivariate Autoregressive Models with Non-Normal Innovations

Document Type : Research Paper

Authors

1 Department of Statistics, Imam Khomeini International University, Qazvin, Iran

2 Department of Computer Science and Statistics, Faculty of Mathematics, K.N. Toosi University of Technology, Tehran, Iran

Abstract

‎In this paper we consider the estimation, ‎order and model selection of autoregressive time series model which may be driven by non-normal innovations. ‎The paper makes two contributions. ‎First, ‎we consider the method of moments for a univariate and also a bivariate time series model; the importance of using the method of moments is that it can provide us with consistent estimates easily for any model order and for any kind of distribution that we can assume for the non-normal innovations‎. ‎Second, ‎we provide methods for order and model selection, ‎i.e‎. ‎for selecting the order of the autoregression and the model for the innovation's distribution. ‎Our analysis provides analytic results on the asymptotic distribution of the method of moments estimators and also computational results via simulations‎. ‎Our results show that although the performance of modified maximum likelihood estimators is better than method of moments estimators when the sample size is small but both methods have approximately same performance as the sample size increase and in misspecification case. ‎Also It is shown that focussed information criterion is an appropriate criterion for model selection for autoregressive models with non-normal innovations based on the method of moments estimators.

Keywords

References

[1] H. Akaike, Fitting autoregressive models for prediction, Ann. Inst. Stat. Math 21: 243-247, (1969).
[2] H. Akaike, Information theory and an extension of the maximum likelihood principle, in the Second International Symposium on Information Theory, eds. by B.N. Petrov and F. Csake, Akademiai Kiado, Hungary, 267-281, ( 1973).
[3] A.D. Akkaya, and M.L. Tiku, Estimating parameters in autoregressive models in non-normal situations: asymmetric innovations, Communications in Statistics Theory and Methods 30: 517-536, ( 2001a).
[4] A.D. Akkaya, and M.L. Tiku, Corrigendum: time series models with asymmetric in-novations, Communications in Statistics Theory and Methods 30 (10): 2227-2230, (2001b).
[5] A.D. Akkaya, and M.L. Tiku, Time series AR(1) model for short tail distribution, Statistics 39 (2): 117-132, ( 2005).
[6] N. Balakrishna, Non-Gaussian autoregressive - type time Series, Springer Nature (2022).
[7] O.T. Bayrak, and A.D. Akkaya, Estimating parameters of a multiple autoregressive model by the modi ed maximum likelihood method, Journal of Computational and Applied Mathematics 233: 1763-1772, ( 2010).
[8] P. Bondon, Estimation of autoregressive models with epsilon-skew-normal innovations, Journal of Multivariate Analysis 100, 1761-1776, (2009).
[9] G. E. P. Box and G. M. Jenkins, Time series analysis forecasting and control, 2nd ed., Holden-Day, San Franscisco, ( 1976).
[10] G. Claeskens, and N. L. Hjort, The focused information criterion with discussion, Journal of the American Statistical Association 98: 900-916, ( 2003).
[11] G. Claeskens, C. Croux, and J. Van Kerckhoven, "Prediction focussed model selection for autoregressive models, Australian & New Zealand Journal of Statistics 49 (4): 359-379, ( 2007).
[12] M. Freimer, G.S. Mudholkar, G. Kollia, and C.T. Lin, A study of the generalized Tukey lambda family, Communications in Statistics: Theory and Methods 17 (10): 3547-3567,( 1988).
[13] D. P. Gaver and P. A. Lewis, First order autoregressive Gamma sequences and point processes, Adv. Appl. Prob 2 : 727-745, ( 1980).
[14] C. Gourieroux, and J. Jasiak, Autoregressive gamma processes, Journal of forecasting 25(2), 129 -152, (2006).
[15] S. Kullback and R. A. Leibler, Information and suciency modelling, Annals of Mathematical Statistics 22: 79-86, ( 1951).
[16] R. Shibata, Approximate eciency of a selection procedure for the number of regression variables, Biometrika 71 (1): 43-49, ( 1984).
[17] A. G. W. Steyn, Estimating parameters in an autoregressive process by combining the methods of moments and of least squares, South African Statistical Journal 14(2), 103-120, (1980).
[18] M. L. Tiku, Estimating the mean and standard deviation from a censored Normal sample, Biometrica 54 : 155-165, ( 1967).
[19] G. Walker, On periodicity in series of related terms, Proceedings of the Royal Society of London, Ser. A. 131: 518-532, ( 1931).
[20] G. Yule, On a method of investigating periodicities in disturbed series with special reference to wolfer's sunspot numbers, Philosophical Transactions of the Royal Society of London, Ser. A. 226: 267-298, ( 1927).

Files

History

  • Receive Date: 22 January 2022
  • Revise Date: 15 May 2022
  • Accept Date: 07 June 2022

Share

How to cite

Statistics