Cramér-von-Mises criterion

In statistics the Cramér-von-Mises criterion is a form of minimum distance estimation used for judging the goodness of fit of a probability distribution $F^*$ compared to a given distribution $F$ is given by

:$n\; W^2\; =\; n\; int\_\{-infty\}^\{infty\}\; [F(x)-F^*(x)]\; ^2,mathrm\{d\}F(x)$

In one-sample applications $F$ is the theoretical distribution and $F^*$ is the empirically observed distribution. Alternatively the two distributions can both be empirically estimated ones; this is called the two-sample case.

The criterion is named after Harald Cramér and Richard Edler von Mises who first proposed it in 1928-1930. The generalization to two samples is due to Anderson (1962).

The Cramér-von-Mises test is an alternative to the Kolmogorov-Smirnov test. It is thought that the CvM test is more powerful than the KS test, but this has not been shown theoretically.

Cramér-von-Mises test (one sample)

Let $x\_1,x\_2,cdots,x\_n$ be the observed values, in increasing order. Then it is possible to show that

:$T\; =\; n\; W^2\; =\; frac\{1\}\{12n\}\; +\; sum\_\{i=1\}^n\; left\; [\; frac\{2i-1\}\{2n\}-F(x\_i)\; ight]\; ^2.$

If this value is larger than the tabulated value we can reject the hypothesis that the data come from the distribution $F(.)$.

Cramér-von-Mises test (two samples)

Let $x\_1,x\_2,cdots,x\_n$ and $y\_1,y\_2,cdots,y\_m$ be the observed values in the first and second sample respectively, in increasing order. Let $r\_1,r\_2,cdots,r\_n$ be the ranks of the x's in the combined sample, and let $s\_1,s\_2,cdots,s\_m$ be the ranks of the y's in the combined sample. It can be shown that

:$T\; =\; n\; W^2\; =\; frac\{U\}\{n\; m\; (n+m)\}-frac\{4\; m\; n\; -\; 1\}\{6(m+n)\}$

where U is defined as

:$U\; =\; n\; sum\_\{i=1\}^n\; (r\_i-i)^2\; +\; m\; sum\_\{j=1\}^m\; (s\_j-j)^2$

If the value of T is larger than the tabulated value we can reject the hypothesis that the two samples come from the same distribution. (Some books give critical values for U, which is more convenient, as it avoids the need to compute T via the expression above. The conclusion will be the same).

References

*cite journal
last= Anderson
first= TW
year= 1962
title= On the Distribution of the Two-Sample Cramer-von Mises Criterion
journal= The Annals of Mathematical Statistics
volume= 33
issue= 3
pages= 1148–1159
publisher= Institute of Mathematical Statistics
issn= 0003-4851
doi= 10.1214/aoms/1177704477
url= http://projecteuclid.org/DPubS/Repository/1.0/Disseminate?view=body&id=pdf_1&handle=euclid.aoms/1177704477
format= PDF
accessdate= 2008-09-23

Xiao, Gordon, Yakovlev: 'A C++ program for the Cramér-von-Mises two sample test', Journal of Statistical Software, 17 #8, January 2007 [http://www.jstatsoft.org/v17/i08/paper]