Bootstrap methods for dependent data: A review

다국어 초록 (Multilingual Abstract)

This paper gives a review on a variety of bootstrap methods for dependent data. The main focus is not on an exhaustive listing and description of bootstrap procedures but on general principles which should be taken into account when selecting a particular bootstrap procedure in order to approximate the (properly standardized) distribution of a statistic of interest. Questions are considered related to which dependence properties of the underlying data generating process asymptotically influence the distribution of the statistic of interest and which dependence properties (or even which process) a particular bootstrap method really mimics. For answering these questions we introduce the concept of a companion stochastic process. As statistics we consider generalized means, and integrated periodogram statistics (including ratio statistics) as well as nonparametric estimators.

참고문헌 (Reference)

1 Parker, C., "Unit root testing via the stationary bootstrap" 133 : 601-638, 2006

2 Brockwell, P., "Time series: theory and methods (2nd ed.)" New York: Springer 1991

3 Brillinger, D. R, "Time series: data analysis and theory" San Francisco: Holden-Day Inc 1981

4 Lahiri,S.N, "Theoretical comparisons of block bootstrap methods" 27 : 386-404, 1999

5 Carlstein,E, "The use of subseries values for estimating the variance of a general statistics from a stationary time series" 14 : 1171-1179, 1986

6 Paparoditis, E., "The tapered block bootstrap for general statistics from stationary sequences" 5 : 131-148, 2002

7 Paparoditis, E., "The tapered block bootstrap" 88 : 1105-1119, 2001

8 Anderson, T. W., "The statistical analysis of time series" New York: Wiley 1971

9 Politis, D. N., "The stationary bootstrap" 89 : 1303-1313, 1994

10 Jentsch, C., "The multiple hybrid bootstrap: resampling multivariate linear processes" 101 : 2320-2345, 2010

11 Paparoditis, E., "The local bootstrap for periodogram statistics" 20 : 193-222, 1999

12 Paparoditis, E., "The local bootstrap for kernel estimators under general dependence conditions" 52 : 139-159, 2000

13 Paparoditis, E., "The local bootstrap for Markov processes" 108 : 301-328, 2003

14 Künsch, H. R., "The jackknife and the bootstrap for general stationary observations" 17 : 1217-1241, 1989

15 Shao, J., "The jackknife and bootstrap" New York: Springer 1995

16 Politis, D. N., "The impact of bootstrap methods on time series analysis" 18 : 219-230, 2003

17 Shao,X, "The dependent wild bootstrap" 105 : 218-235, 2010

18 Hall, P., "The bootstrap and Edgeworth expansion" New York: Springer 1992

19 Bühlmann, P., "The blockwise bootstrap for general parameters of a stationary time series" 22 : 35-54, 1995

20 Andrews, D., "The block block bootstrap: improved asymptotic refinements" 72 : 673-700, 2004

21 Kirch, C., "TFT-bootstrap: resampling time series in the frequency domain to obtain replicates in the time domain" 39 : 1427-1470, 2011

22 Politis, D. N., "Subsampling for econometric models—comments on bootstrapping time series models" 15 : 169-176, 1996

23 Politis, D. N., "Subsampling" New York: Springer 1999

24 Rosenblatt, M., "Stationary sequences and random fields" Boston: Birkhäuser 1985

25 Psaradakis,Z, "Sieve bootstrap test for stationarity" 62 : 263-274, 2003

26 Bühlmann, P., "Sieve bootstrap for time series" 3 : 123-148, 1997

27 Bühlmann, P., "Sieve bootstrap for smoothing in nonstationary time series" 26 : 48-83, 1998

28 Götze, F., "Second-order correctness of the blockwise bootstrap for stationary observations" 24 : 1914-1933, 1996

29 Paparoditis, E., "Residual-based block bootstrap for unit root testing" 71 : 813-856, 2003

30 Carey, V. J, "Resampling methods for dependent data" 100 : 712-713, 2005

31 Lahiri, S. N., "Resampling methods for dependent data" New York: Springer 2003

32 Paparoditis, E., "Resampling and subsampling for financial time series, In Handbook of financial time series" New York: Springer 983-999, 2009

33 Hall, P., "Resampling a coverage pattern" 20 : 231-246, 1985

34 Neumann, M. H., "Regression-type inference in nonparametric autoregression" 26 : 1570-1613, 1998

35 Berkowitz, J., "Recent developments in bootstrapping time series" 19 : 1-48, 2000

36 Poskitt, D. S, "Properties of the sieve bootstrap for fractionally integrated and non-invertible processes" 29 : 224-250, 2008

37 Franke, J., "Properties of the nonparametric autoregressive bootstrap" 23 : 555-585, 2002

38 Paparoditis, E., "Order identification statistics in stationary autoregressive moving average models: vector autocorrelations and the bootstrap" 13 : 415-435, 1991

39 Kreiss, J.-P., "On the range of validity of the autoregressive sieve bootstrap" 2011

40 Lahiri, S. N., "On the moving block bootstrap under long range dependence" 18 : 405-413, 1993

41 Freedman, D. A., "On bootstrapping two-stage least squares estimates in stationary linear models" 12 : 827-842, 1984

42 Franke, J., "On bootstrapping Kernel spectral estimates" 20 : 121-145, 1992

43 Hall, P., "On blocking rules for the bootstrap with dependent data" 28 : 561-574, 1995

44 Datta, S., "On asymptotic properties of bootstrap for AR(1) processes" 53 : 361-374, 1996

45 Davison, A. C., "On Studentizing and blocking methods for implementing the bootstrap with dependent data" 35 : 215-224, 1993

46 Kreiss, J.-P., "Nonparametric estimation and bootstrap for financial time series, In Statistics and finance: an interface" London: Imperial College Press 2000

47 Liu, R. Y., "Moving blocks jackknife and bootstrap capture weak dependence, In Exploring the limits of bootstrap" New York: Wiley 225-248, 1992

48 Carlstein, E., "Matched-block bootstrap for dependent data" 4 : 305-328, 1998

49 Dowla, A., "Locally stationary processes and the local block bootstrap, In Recent advances and trends in nonparametric statistics" North Holland: Elsevier 437-444, 2003

50 Paparoditis, E., "Local block bootstrap" 335 : 959-962, 2002

51 Kim, Y.-M., "Large sample properties of a block bootstrap method under long range dependence, in Sankhy¯a Series A" 2011

52 Wu, C. F. J., "Jackknife, bootstrap and other resampling methods in regression analysis (with discussion)" 14 : 1261-1350, 1986

53 Hall, P., "Inference in ARCH and GARCH models with heavy-tailed errors" 71 : 285-317, 2003

54 Andrews, D, "Higher order improvement of a computationally attractive k-step bootstrap of extremum estimators" 70 : 119-162, 2002

55 Neumann, M. H., "Goodness-of-fit tests for Markovian time series models" 14 : 14-46, 2008

56 Hurvich, C. M., "Frequency domain bootstrap methods for time series" Department of Statistics and Operations Research, New York University 1987

57 Paparoditis, E., "Frequency domain bootstrap for time series, In Empirical process techniques for dependent data" Boston: Birkhäuser 365-381, 2002

58 Pourahmadi, "Foundations of time series analysis and prediction theory" New York: Wiley 2001

59 Shao, X., "Extended tapered block bootstrap" 20 : 807-821, 2010

60 Lahiri,S.N, "Edgeworth correction by moving block bootstrap for stationary and nonstationary data, In Exploring the limits of bootstrap" New York: Wiley 1992

61 Bose, A., "Edgeworth correction by bootstrap in autoregressions" 16 : 1709-1722, 1988

62 Patton, A., "Correction to ‘‘Automatic block-length selection for the dependent bootstrap by D.N. Politis and H. White’’" 28 : 372-375, 2009

63 Gonçalves, S., "Consistency of the stationary bootstrap under weak moment conditions" Department de Sciences Economiques, Université de Montreal 2003

64 Bühlmann, P., "Bootstraps for time series" 17 : 52-72, 2002

65 Basawa, I. V., "Bootstrapping unstable first-order autoregressive processes" 19 : 1098-1101, 1991

66 Paparoditis, E., "Bootstrapping unit root tests for autoregressive time series" 100 : 545-553, 2005

67 Li, H., "Bootstrapping time series models" 15 : 115-158, 1996

68 Sergides, M., "Bootstrapping the local periodogram of locally stationary processes" 30 : 260-261, 2008

69 Franke, J., "Bootstrapping stationary autoregressive moving-average models" 13 : 297-317, 1992

70 Gonçalves, S., "Bootstrapping realized volatility" Department de Sciences Economiques, Université de Montreal and Imperial College London 2008

71 Dovonon, P., "Bootstrapping realized multivariate volatility measures" Department de Sciences Economiques, Université de Montreal and Imperial College London 2008

72 Kreiss, J.-P., "Bootstrapping locally stationary processes" 2010

73 Heimann, G., "Bootstrapping general first order autoregression" 30 : 87-98, 1996

74 Dette, H., "Bootstrapping frequency domain tests in multivariate time series with an application to testing equality of spectral densities" 71 : 831-857, 2009

75 Ruiz, E., "Bootstrapping financial time series. Journal of Economic Surveys Reprinted in: Contributions to Financial Econometrics: Theoretical and Practical Issues" Blackwell 271-300, 2002

76 Paparoditis, E., "Bootstrapping autoregressive and moving average parameter estimates of infinite order vector autoregressive processes" 57 : 277-296, 1996

77 Kulperger, R. J., "Bootstrapping a finite state Markov chain" 51 : 178-191, 1989

78 Athreya, K. B., "Bootstrapping Markov chains: countable case" 33 : 311-331, 1992

79 Kreiss, J.-P., "Bootstrap tests for simple structures in nonparametric time series regression" 1 : 367-380, 2008

80 Kreiss, J.-P., "Bootstrap tests for parametric volatility structure in nonparametric autoregression" Prob. theory and math. stat 393-404, 1999

81 Psaradakis,Z, "Bootstrap tests for an autoregressive unit root in the presence of weakly dependent errors" 22 : 577-594, 2001

82 Zoubir, A. M., "Bootstrap techniques for signal processing" Cambridge University Press 2004

83 Hidalgo, J., "Bootstrap specification tests for linear covariance stationary processes" 133 : 807-839, 2005

84 Kreiss,J.-P, "Bootstrap procedures for AR(∞)-processes" Proc. Bootstrapping and Related Techniques 376 : 107-113, 1992

85 Pascual, L., "Bootstrap prediction for returns and volatilities in GARCH models" 50 : 2293-2312, 2006

86 Franke, J., "Bootstrap order selection for autoregressive processes" 24 : 305-325, 2006

87 Franke, J., "Bootstrap of kernel smoothing in nonlinear time series" 8 : 1-37, 2002

88 Efron, B., "Bootstrap methods: another look at the jackknife" 7 : 1-26, 1979

89 Horowitz, J. L., "Bootstrap methods for Markov processes" 71 : 1049-1082, 2003

90 Davison, A. C., "Bootstrap methods and their application" Cambridge, UK: Cambridge University Press 1997

91 Datta, S., "Bootstrap inference for a first-order autoregression with positive innovations" 90 : 1289-1300, 1995

92 Bose, A., "Bootstrap in moving average models" 42 : 753-768, 1990

93 Rajarshi,M.B, "Bootstrap in Markov sequences based on estimates of transition density" 42 : 253-268, 1990

94 Härdle, W., "Bootstrap for time series" 71 : 435-459, 2003

95 Choi, E., "Bootstrap confidence regions computed from autoregressions of arbitrary order" 62 : 461-477, 2000

96 Bühlmann, P., "Blockwise bootstrapped empirical processes for stationary sequences" 22 : 995-1012, 1994

97 Psaradakis, Z., "Blockwise bootstrap testing for stationarity" 76 : 562-570, 2006

98 Bühlmann, P., "Block length selection in the bootstrap for time series" 31 : 295-310, 1999

99 McMurry, T., "Banded and tapered estimates of autocovariance matrices and the linear process bootstrap" 31 : 471-482, 2010

100 Kreiss, J.-P., "Autoregressive aided periodogram bootstrap for time series" 31 : 1923-1955, 2003

101 Politis, D. N., "Automatic block-length selection for the dependent bootstrap" 23 : 53-70, 2004

102 Kreiss,J.-P, "Asymptotical properties of residual bootstrap for autoregression" Preprint TU Braunschweig 1997

103 van der Vaart,A.W, "Asymptotic statistics" Cambridge University Press 2000

104 Kreiss, J.-P., "Asymptotic statistical inference for a class of stochastic processes" Habilitationsschrift. Universität Hamburg 1988

105 Shao, X., "Asymptotic spectral theory for nonlinear time series" 35 : 1773-1801, 2007

106 Rosenblatt,M, "Asymptotic normality, strong mixing and spectral density estimates" 12 : 1167-1180, 1984

107 Dahlhaus, R., "Asymptotic normality of spectral estimates" 16 : 412-431, 1985

108 Gonçalves, S., "Asymptotic and bootstrap inference for AR(∞) processes with conditional heteroskedasticity" 26 : 609-641, 2007

109 Park, J. Y, "An invariance principle for sieve bootstrap in time series" 18 : 468-490, 2002

110 Efron, B., "An introduction to the bootstrap" New York: Chapman and Hall 1993

111 Hidalgo, J, "An alternative bootstrap to moving blocks for time series regression models" 117 : 369-399, 2003

112 Grenander, U., "Abstract inference" New York: Wiley 1981

113 Bose, A., "A review of the bootstrap for dependent samples, In Stochastic processes and statistical inference" New Delhi: New Age International Publishers 39-51, 1995

114 Nordman, D. J., "A note on the stationary bootstrap" 37 : 359-370, 2009

115 Lahiri, S. N., "A nonparametric plug-in method for selecting the optimal block length" 4 : 292-321, 2007

116 Bickel, P. J., "A new mixing notion and functional central limit theorems for a Sieve bootstrap in time series" 5 : 413-446, 1999

117 Kapetanios, G, "A generalization of a Sieve bootstrap invariance principle to long memory processes" 4 : 19-40, 2010

118 Politis, D. N., "A general resampling scheme for triangular arrays of α-mixing random variables with application to the problem of spectral density estimation" 20 : 1985-2007, 1992

119 Janas, D., "A frequency domain bootstrap for time series" Fairfax Station, VA: Interface Foundation of North America. 423-425, 1994

120 Dahlhaus, R., "A frequency domain bootstrap for ratio statistics in time series analysis" 24 : 1934-1963, 1996

121 Paparoditis, E, "A frequency domain bootstrap based method for checking the fit of a transfer function model" 91 : 1535-1551, 1996

122 Berg, A., "A bootstrap test for time series linearity" 140 : 3841-3857, 2010

123 Paparoditis, E., "A Markovian local resampling scheme for nonparametric estimators in time series analysis" 17 : 540-566, 2001