Correlogram

Correlogram
A plot showing 100 random numbers with a "hidden" sine function, and an autocorrelation (correlogram) of the series on the bottom.
Example for a correlogram

In the analysis of data, a correlogram is an image of correlation statistics. For example, in time series analysis, a correlogram, also known as an autocorrelation plot, is a plot of the sample autocorrelations r_h\, versus h\, (the time lags).

If cross-correlation is used, the result is called a cross-correlogram. The correlogram is a commonly used tool for checking randomness in a data set. This randomness is ascertained by computing autocorrelations for data values at varying time lags. If random, such autocorrelations should be near zero for any and all time-lag separations. If non-random, then one or more of the autocorrelations will be significantly non-zero.

In addition, correlograms are used in the model identification stage for Box–Jenkins autoregressive moving average time series models. Autocorrelations should be near-zero for randomness; if the analyst does not check for randomness, then the validity of many of the statistical conclusions becomes suspect. The correlogram is an excellent way of checking for such randomness.

Contents

Applications

The correlogram can help provide answers to the following questions:

  • Are the data random?
  • Is an observation related to an adjacent observation?
  • Is an observation related to an observation twice-removed? (etc.)
  • Is the observed time series white noise?
  • Is the observed time series sinusoidal?
  • Is the observed time series autoregressive?
  • What is an appropriate model for the observed time series?
  • Is the model
Y = constant + error

valid and sufficient?

  • Is the formula s_{\bar{Y}}=s/\sqrt{N} valid?

Importance

Randomness (along with fixed model, fixed variation, and fixed distribution) is one of the four assumptions that typically underlie all measurement processes. The randomness assumption is critically important for the following three reasons:

  • Most standard statistical tests depend on randomness. The validity of the test conclusions is directly linked to the validity of the randomness assumption.
  • Many commonly-used statistical formulae depend on the randomness assumption, the most common formula being the formula for determining the standard deviation of the sample mean:

s_{\bar{Y}}=s/\sqrt{N}

where s is the standard deviation of the data. Although heavily used, the results from using this formula are of no value unless the randomness assumption holds.

  • For univariate data, the default model is
Y = constant + error

If the data are not random, this model is incorrect and invalid, and the estimates for the parameters (such as the constant) become nonsensical and invalid.

Estimation of autocorrelations

The autocorrelation coefficient at lag h is given by


r_h = c_h/c_0 \,

where ch is the autocovariance function


c_h = \frac{1}{N}\sum_{t=1}^{N-h} \left(Y_t - \bar{Y}\right)\left(Y_{t+h} - \bar{Y}\right)

and c0 is the variance function


c_0 = \frac{1}{N}\sum_{t=1}^{N} \left(Y_t - \bar{Y}\right)^2

The resulting value of rh will range between -1 and +1.

Alternate estimate

Some sources may use the following formula for the autocovariance function:


c_h = \frac{1}{N-h}\sum_{t=1}^{N-h} \left(Y_t - \bar{Y}\right)\left(Y_{t+h} - \bar{Y}\right)

Although this definition has less bias, the (1/N) formulation has some desirable statistical properties and is the form most commonly used in the statistics literature. See pages 20 and 49-50 in Chatfield for details.

Statistical inference with correlograms

In the same graph one can draw upper and lower bounds for autocorrelation with significance level \alpha\,:

B=\pm z_{1-\alpha/2} SE(r_h)\, with r_h\, as the estimated autocorrelation at lag h\,.

If the autocorrelation is higher (lower) than this upper (lower) bound, the null hypothesis that there is no autocorrelation at and beyond a given lag is rejected at a significance level of \alpha\,. This test is an approximate one and assumes that the time-series is Gaussian.

In the above, z1-α/2 is the quantile of the normal distribution; SE is the standard error, which can be computed by Bartlett's formula for MA(l) processes:

SE(r_1)=\frac {1} {\sqrt{N}}
 SE(r_h)=\sqrt\frac{1+2\sum_{i=1}^{h-1} r^2_i}{N} for h>1.\,

In the picture above we can reject the null hypothesis that there is no autocorrelation between time-points which are adjacent (lag=1). For the other periods one cannot reject the null hypothesis of no autocorrelation.

Note that there are two distinct formulas for generating the confidence bands:

1. If the correlogram is being used to test for randomness (i.e., there is no time dependence in the data), the following formula is recommended:


\pm \frac{z_{1-\alpha/2}}{\sqrt{N}}

where N is the sample size, z is the quantile function of the standard normal distribution and α is the significance level. In this case, the confidence bands have fixed width that depends on the sample size.

2. Correlograms are also used in the model identification stage for fitting ARIMA models. In this case, a moving average model is assumed for the data and the following confidence bands should be generated:


\pm z_{1-\alpha/2}\sqrt{\frac{1}{N}\left(1+2\sum_{i=1}^{k} y_i^2\right)}

where k is the lag. In this case, the confidence bands increase as the lag increases.

Software

Correlograms are available in most general purpose statistical software programs. In R, the function acf and pacf can be used to produce such a plot.

Related techniques

  • Partial autocorrelation plot
  • Lag plot
  • Spectral plot
  • Seasonal subseries plot

External links

Further reading

  • Hanke, John E./Reitsch, Arthur G./Wichern, Dean W. (2001). Business forecasting (7th edition ed.). Prentice Hall. 
  • Box, G. E. P., and Jenkins, G. (1976). Time Series Analysis: Forecasting and Control. Holden-Day. 
  • Chatfield, C. (1989). The Analysis of Time Series: An Introduction (Fourth Edition ed.). Chapman & Hall. 

 This article incorporates public domain material from websites or documents of the National Institute of Standards and Technology.



Wikimedia Foundation. 2010.

Игры ⚽ Нужно решить контрольную?

Look at other dictionaries:

  • correlogram — noun A graph that shows the correlation between two variables …   Wiktionary

  • correlogram — cor·rel·o·gram …   English syllables

  • correlogram — kəˈreləˌgram noun ( s) Etymology: correlation + o + gram : a curve plotted to exhibit the assumed correlation between two mathematical variables called also correlation curve …   Useful english dictionary

  • CrimeStat — Primary File page of CrimeStat CrimeStat is a Windows based spatial statistic software program that conducts spatial and statistical analysis and is designed to interface with a Geographic Information System. The program is developed by Ned… …   Wikipedia

  • Nigel Anstey — Nigel Allister Anstey, British geophysicist, has made major contributions to seismic exploration, which are the foundations for many of the techniques used in today’s oil and gas exploration. Anstey’s contributions impact every major area of… …   Wikipedia

  • Comparison of statistical packages — The following tables compare general and technical information for a number of statistical analysis packages. Contents 1 General information 2 Operating system support 3 ANOVA 4 Regression …   Wikipedia

  • List of works by Salvador Dalí — The Philadelphia Museum of Art used a surreal entrance display including its steps, for the 2005 Salvador Dalí exhibition Salvador Dalí produced over 1,500 paintings in his career,[1] in addition to producing illustrations for books, lithographs …   Wikipedia

  • Список работ Сальвадора Дали — Сальвадор Дали в 1939 году …   Википедия

  • Arithmetic mean — In mathematics and statistics, the arithmetic mean, often referred to as simply the mean or average when the context is clear, is a method to derive the central tendency of a sample space. The term arithmetic mean is preferred in mathematics and… …   Wikipedia

  • Analysis of variance — In statistics, analysis of variance (ANOVA) is a collection of statistical models, and their associated procedures, in which the observed variance in a particular variable is partitioned into components attributable to different sources of… …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”