Wald's equation

Wald's equation

In probability theory, Wald's equation is an important identity which simplifies the calculation of the expected value of the sum of a random number of random quantities. Formally, it relates the expectation of a sum of randomly many i.i.d. random variables to the expected number of terms in the sum and the random variables' common expectation.

Let "X"1, "X"2, ..., "X""T" be a sequence of "T" i.i.d. random variables distributed identically to some random variable "X", such that
# "T" > 0 is itself a random variable (integer-valued),
# the expectation of "X", E("X") < ∞, and
# E("T") < ∞.

Then::operatorname{E}left(sum_{i=1}^{T}X_i ight)=operatorname{E}(T)operatorname{E}(X).

In this case, the random number "T" acts as a stopping time for the stochastic process { "X""i", "i" = 1, 2, ... }.

Proof

Define a second sequence of random variables, "Y_n":

Y_n = sum_{i=1}^{n}X_i - noperatorname{E}(X)

It can be seen from elementary probability that "Y_n" is a martingale, and moreover satisfies the conditions of the optional stopping theorem. Hence

operatorname{E}left(sum_{i=1}^{T}X_i - Toperatorname{E}(X) ight) = operatorname{E}(Y_T) = operatorname{E}(Y_0) = 0

And the result follows by simple rearrangement.

Proof #2

Let Xi be independent and identically distributed (iid) variables with mean μX , and N a non-negative random number with mean μN independent of all Xi. Define Y:

Y = sum_{i=1}^{N}X_i

Then the expectation of Y, E [Y] is:

E [Y] = E left [ sum_{i=1}^{N}X_i ight]

Condition the expectation on the variable N:

egin{align} E [Y] &= sum_{n=0}^infty E left [ sum_{i=1}^{n} X_i ~ | ~ N=n ight] P_N(n) \ &= sum_{n=0}^infty left( sum_{i=1}^{n}E [X_i ~ | ~ N=n] ight) P_N(n) \ &= sum_{n=0}^infty left( sum_{i=1}^{n}E [X_i] ight) P_N(n) \ &= sum_{n=0}^infty n mu_X P_N(n) \ &= mu_X sum_{n=0}^infty n P_N(n) \ &= mu_X mu_N end{align}

The the second line is due to the linearity of the conditional expectation, the third line due to the independence of Xi and N.

ee also

*Abraham Wald

References

*cite journal|last = Wald|first = Abraham|title = On Cumulative Sums of Random Variables|journal = The Annals of Mathematical Statistics|volume = 15|issue = 3|date = Sep 1944|pages = 283–296|url = http://links.jstor.org/sici?sici=0003-4851%28194409%2915%3A3%3C283%3AOCSORV%3E2.0.CO%3B2-0&size=LARGE|doi = 10.1214/aoms/1177731235|month = Sep|year = 1944
*


Wikimedia Foundation. 2010.

Игры ⚽ Нужен реферат?

Look at other dictionaries:

  • Abraham Wald — Infobox Scientist name = Abraham Wald box width = image width = caption = A young Wald birth date = birthdate|1902|10|31 birth place = Cluj Napoca, Hungary death date = death date and age|1950|12|13|1902|10|31 death place = Travancore, India… …   Wikipedia

  • List of mathematics articles (W) — NOTOC Wad Wadge hierarchy Wagstaff prime Wald test Wald Wolfowitz runs test Wald s equation Waldhausen category Wall Sun Sun prime Wallenius noncentral hypergeometric distribution Wallis product Wallman compactification Wallpaper group Walrasian… …   Wikipedia

  • Expected value — This article is about the term used in probability theory and statistics. For other uses, see Expected value (disambiguation). In probability theory, the expected value (or expectation, or mathematical expectation, or mean, or the first moment)… …   Wikipedia

  • List of probability topics — This is a list of probability topics, by Wikipedia page. It overlaps with the (alphabetical) list of statistical topics. There are also the list of probabilists and list of statisticians.General aspects*Probability *Randomness, Pseudorandomness,… …   Wikipedia

  • General relativity — For a generally accessible and less technical introduction to the topic, see Introduction to general relativity. General relativity Introduction Mathematical formulation Resources …   Wikipedia

  • Projet:Mathématiques/Liste des articles de mathématiques — Cette page n est plus mise à jour depuis l arrêt de DumZiBoT. Pour demander sa remise en service, faire une requête sur WP:RBOT Cette page recense les articles relatifs aux mathématiques, qui sont liés aux portails de mathématiques, géométrie ou… …   Wikipédia en Français

  • General relativity resources — BooksPopular*cite book | author=Geroch, Robert | authorlink = Robert Geroch| title=General Relativity from A to B | location=Chicago | publisher=University of Chicago Press | year=1981 | id=ISBN 0 226 28864 1 Leisurely pace, provides superb… …   Wikipedia

  • Processus de Galton-Watson — Le processus de Galton Watson est un processus stochastique permettant de décrire des dynamiques de populations. Sommaire 1 Historique 2 Formulation générale 3 Paramètre critique et classification des processus de Galton Watson …   Wikipédia en Français

  • List of statistics topics — Please add any Wikipedia articles related to statistics that are not already on this list.The Related changes link in the margin of this page (below search) leads to a list of the most recent changes to the articles listed below. To see the most… …   Wikipedia

  • Mass in general relativity — General relativity Introduction Mathematical formulation Resources Fundamental concepts …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”