Wiener process

In mathematics, the Wiener process is a continuous-time stochastic process named in honor of Norbert Wiener. It is often called Brownian motion, after Robert Brown. It is one of the best known Lévy processes (càdlàg stochastic processes with stationary independent increments) and occurs frequently in pure and applied mathematics, economics and physics.

The Wiener process plays an important role both in pure and applied mathematics. In pure mathematics, the Wiener process gave rise to the study of continuous time martingales. It is a key process in terms of which more complicated stochastic processes can be described. As such, it plays a vital role in stochastic calculus, diffusion processes and even potential theory. It is the driving process of SLE. In applied mathematics, the Wiener process is used to represent the integral of a white noise process, and so is useful as a model of noise in electronics engineering, instruments errors in filtering theory and unknown forces in control theory.

The Wiener process has applications throughout the mathematical sciences. In physics it is used to study Brownian motion, the diffusion of minute particles suspended in fluid, and other types of diffusion via the Fokker-Planck and Langevin equations. It also forms the basis for the rigorous path integral formulation of quantum mechanics (by the Feynman-Kac formula, a solution to the Schrödinger equation can be represented as a Wiener integral) and the study of eternal inflation in physical cosmology. It is also prominent in the mathematical theory of finance, in particular the Black–Scholes option pricing model.

Characterizations of the Wiener process

The Wiener process "W"_t is characterized by three facts:
#"W"₀ = 0
#"W"_"t" is almost surely continuous
#"W"_"t" has independent increments with distribution $W\_t-W\_ssim\; mathcal\{N\}(0,t-s)$ (for 0 &le; "s" < "t")."N"("&mu;", "&sigma;"²) denotes the normal distribution with expected value "&mu;" and variance "&sigma;"². The condition that it has independent increments means that if 0 &le; "s"₁ &le; "t"₁ &le; "s" ₂ &le; "t"₂ then "W"_"t"1 − "W"_"s"1 and "W"_"t"2 − "W"_"s"2 are independent random variables, and the similar condition holds for "n" increments.

An alternative characterization of the Wiener process is the so-called "Lévy characterization" that says that the Wiener process is an almost surely continuous martingale with "W"₀ = 0 and quadratic variation ["W"_"t", "W"_"t"] = "t" (which means that "W"_"t"²-"t" is also a martingale).

A third characterization is that the Wiener process has a spectral representation as a sine series whose coefficients are independent "N"(0,1) random variables. This representation can be obtained using the Karhunen-Loève theorem.

The Wiener process can be constructed as the scaling limit of a random walk, or other discrete-time stochastic processes with stationary independent increments. This is known as Donsker's theorem. Like the random walk, the Wiener process is recurrent in one or two dimensions (meaning that it returns almost surely to any fixed neighborhood of the origin infinitely often) whereas it is not recurrent in dimensions three and higher. Unlike the random walk, it is scale invariant, meaning that

:$alpha^\{-1\}W\_\{alpha^2\; t\},$

is a Wiener process for any nonzero constant α. The Wiener measure is the probability law on the space of continuous functions "g", with "g"(0) = 0, induced by the Wiener process. An integral based on Wiener measure may be called a Wiener integral.

Properties of a one-dimensional Wiener process

The unconditional probability density function at a fixed time "t":

:$f\_\{W\_t\}(x)\; =\; frac\{1\}\{sqrt\{2\; pi\; t\; e^\{-x^2/\{2\; t\}\; \}.$

The expectation is zero:

:$E(W\_t)\; =\; 0.$

The variance is "t":

:$E(W^2\_t)\; -\; E^2(W\_t)\; =\; t.$

The covariance and correlation:

:$operatorname\{cov\}(W\_s,W\_t)\; =\; min(s,t)\; ,\; ,$

:$operatorname\{corr\}(W\_s,W\_t)\; =\; frac\{min(s,t)\}\{sqrt\{st\; =\; sqrt\{\; frac\{\; min(s,t)\; \}\{\; max(s,t)\; \}\; \}\; ,\; .$

Derivation

The first three properties follow from the definition that "W"_"t" (at a fixed time "t") is normally distributed:

:$W\_t-W\_0\; =\; W\_t\; sim\; mathcal\{N\}(0,t).$

Suppose that "t"₁ < "t"₂.

:$R\; (t\_1,\; t\_2)\; =\; Eleft\; [(W\_\{t\_1\}-E\; [W\_\{t\_1\}]\; )\; cdot\; (W\_\{t\_2\}-E\; [W\_\{t\_2\}]\; )\; ight]\; =\; E\; [W\_\{t\_1\}\; cdot\; W\_\{t\_2\}]$

Substitute the simple identity $W\_\{t\_2\}\; =\; (\; W\_\{t\_2\}\; -\; W\_\{t\_1\}\; )\; +\; W\_\{t\_1\}$ :

:$E\; [W\_\{t\_1\}\; cdot\; W\_\{t\_2\}]\; =\; Eleft\; [W\_\{t\_1\}\; cdot\; ((W\_\{t\_2\}\; -\; W\_\{t\_1\})+\; W\_\{t\_1\})\; ight]\; =\; Eleft\; [W\_\{t\_1\}\; cdot\; (W\_\{t\_2\}\; -\; W\_\{t\_1\}\; )\; ight]\; +\; E\; [W\_\{t\_1\}^2]$

Since "W"("t"₁) = "W"("t"₁) − "W"("t"₀) and "W"("t"₂) − "W"("t"₁), are independent,

:$E\; [W\_\{t\_1\}\; cdot\; (W\_\{t\_2\}\; -\; W\_\{t\_1\}\; )]\; =\; E\; [W\_\{t\_1\}]\; cdot\; E\; [W\_\{t\_2\}\; -\; W\_\{t\_1\}]\; =\; 0$

Thus

:$R(t\_1,\; t\_2)\; =\; E\; [W\_\{t\_1\}^2]\; =\; t\_1$

Self-similarity

Brownian scaling

For every "c">0 the process $V\_t\; =\; (1/sqrt\; c)\; W\_\{ct\}$ is another Wiener process.

Time reversal

The process $V\_t\; =\; W\_1\; -\; W\_\{1-t\}$ for 0 ≤ "t" ≤ 1 is distributed like $W\_t$ for 0 ≤ "t" ≤ 1.

Time inversion

The process $V\_t\; =\; t\; W\_\{1/t\}$ is another Wiener process.

A class of Brownian martingales

If a polynomial "p"("x","t") satisfies the PDE: $Big(\; frac\{partial\}\{partial\; t\}\; +\; frac12\; frac\{partial^2\}\{partial\; x^2\}\; Big)\; p(x,t)\; =\; 0$then the stochastic process: $M\_t\; =\; p\; (\; W\_t,\; t\; )\; ,$is a martingale.

Example: $W\_t^2\; -\; t$ is a martingale, which shows that the quadratic variation of $W$ on $[0,t]$ is equal to $t.$ It follows that the expected time of first exit of $W$ from $(-c,c)$ is equal to $c^2.$

More generally, for every polynomial "p"("x","t") the following stochastic process is a martingale:: $M\_t\; =\; p\; (\; W\_t,\; t\; )\; -\; int\_0^t\; a(W\_s,s)\; ,\; mathrm\{d\}s\; ,\; ,$where "a" is the polynomial: $a(x,t)\; =\; Big(\; frac\{partial\}\{partial\; t\}\; +\; frac12\; frac\{partial^2\}\{partial\; x^2\}\; Big)\; p(x,t)\; ,\; .$

Example: $p(x,t)\; =\; (x^2-t)^2,$ $a(x,t)\; =\; 4x^2;$ the process $(W\_t^2\; -\; t)^2\; -\; 4\; int\_0^t\; W\_s^2\; ,\; mathrm\{d\}s$ is a martingale, which shows that the quadratic variation of the martingale $W\_t^2\; -\; t$ on $[0,t]$ is equal to $4\; int\_0^t\; W\_s^2\; ,\; mathrm\{d\}s\; .$

Some properties of sample paths

The set of all functions "w" with these properties is of full Wiener measure. That is, a path (sample function) of the Wiener process has all these properties almost surely.

Qualitative properties

* For every ε>0, the function "w" takes both (strictly) positive and (strictly) negative values on (0,ε).

* The function "w" is continuous everywhere but differentiable nowhere (like the Weierstrass function).

* Points of local maximum of the function "w" are a dense countable set; each local maximum is strict; the maximum values are pairwise different. The same holds for local minima.

* The function "w" has no points of local increase, that is, no "t">0 satisfies the following for some ε in (0,"t"): first, "w"("s") ≤ "w"("t") for all "s" in ("t"-ε,"t"), and second, "w"("s") ≥ "w"("t") for all "s" in ("t","t"+ε). (It does not mean that "w" is increasing on ("t"-ε,"t"+ε).) The same holds for local decrease.

* The function "w" is of unbounded variation on every interval.

* Zeros of the function "w" are a nowhere dense perfect set of Lebesgue measure 0 and Hausdorff dimension 1/2.

Quantitative properties

Law of the iterated logarithm

: $limsup\_\{t\; o+infty\}\; frac\{\; |w(t)|\; \}\{\; sqrt\{\; 2t\; loglog\; t\; \}\; \}\; =\; 1.$

Modulus of continuity

Local modulus of continuity:: $limsup\_\{varepsilon\; o0+\}\; frac\{\; |w(varepsilon)|\; \}\{\; sqrt\{\; 2varepsilon\; loglog(1/varepsilon)\; \}\; \}\; =\; 1.$

Global modulus of continuity (Levy)::

Local time

The image of the Lebesgue measure on [0,"t"] under the map "w" (the pushforward measure) has a density $L\_t(cdot).$ Thus,: $int\_0^t\; f(w(s))\; ,\; mathrm\{d\}s\; =\; int\_\{-infty\}^\{+infty\}\; f(x)\; L\_t(x)\; ,\; mathrm\{d\}x$for a wide class of functions "f" (namely: all continuous functions; all locally integrable functions; all non-negative measurable functions). The density $L\_t(cdot)$ is (more exactly, can and will be chosen to be) continuous (which never happens to a non-monotone differentiable function "w"). The number $L\_t(x)$ is called the local time at "x" of "w" on [0,"t"] . It is strictly positive for all "x" of the interval ("a","b") where "a" and "b" are the least and the greatest value of "w" on [0,"t"] , respectively. (For "x" outside this interval the local time evidently vanishes.) Treated as a function of two variables "x" and "t", the local time is still continuous (which never happens to a differentiable function "w", be it monotone or not). Treated as a function of "t" (while "x" is fixed), the local time is a singular function corresponding to a nonatomic measure on the set of zeros of "w".

Related processes

The stochastic process defined by :$\{X\_t\; =\; mu\; t\; +\; sigma\; W\_t\}$ is called a "Wiener process with drift &mu;" and infinitesimal variance &sigma;^{2. These processes exhaust continuous Lévy processes.}

Two random processes on the time interval [0,1] appear, roughly speaking, when conditioning the Wiener process to vanish on both ends of [0,1] . With no further conditioning, the process takes both positive and negative values on [0,1] and is called Brownian bridge. Conditioned also to stay positive on (0,1), the process is called Brownian excursion. In both cases a rigorous treatment involves a limiting procedure, since the formula $P(A|B)\; =\; P(Acap\; B)\; /\; P(B)$ does not work when $P(B)=0.$

A geometric Brownian motion can be written

:

It is a stochastic process which is used to model processes that can never take on negative values, such as the value of stocks.

The stochastic process:$\{\; X\_t\; =\; mathrm\{e\}^\{-t\}\; W\_\{mathrm\{e\}^\{2t\; \}$is distributed like the Ornstein-Uhlenbeck process.

The time of hitting a single point "x">0 by the Wiener process is a random variable with the Lévy distribution. The family of these random variables (indexed by all positive numbers "x") is a left-continuous modification of a Lévy process. The right-continuous modification of this process is given by times of first exit from closed intervals [0,"x"] .

The local time $L\_t(0)$ treated as a random function of "t" is a random process distributed like the process $S\_t\; =\; max\_\{0le\; sle\; t\}\; W\_s.$

The local time $L\_t(x)$ treated as a random function of "x" (while "t" is constant) is a random process described by Ray-Knight theorems in terms of Bessel processes.

Brownian martingales

Let "A" be an event related to the Wiener process (more formally: a set, measurable with respect to the Wiener measure, in the space of functions), and "X"_"t" the conditional probability of "A" given the Wiener process on the time interval [0,"t"] (more formally: the Wiener measure of the set of trajectories whose concatenation with the given partial trajectory on [0,"t"] belongs to "A"). Then the process "X"_"t" is a continuous martingale. Its martingale property follows immediately from the definitions, but its continuity is a very special fact, --- a special case of a general theorem stating that all Brownian martingales are continuous. A Brownian martingale is, by definition, a martingale adapted to the Brownian filtration; and the Brownian filtration is, by definition, the filtration generated by the Wiener process.

Time change

Every continuous martingale (starting at the origin) is a time changed Wiener process.

Example. $2\; W\_t\; =\; V\_\{4t\}$ where $V$ is another Wiener process (different from $W$ but distributed like $W$).

Example. $W\_t^2\; -\; t\; =\; V\_\{A(t)\}$ where $A(t)\; =\; 4\; int\_0^t\; W\_s^2\; ,\; mathrm\{d\}\; s$ and $V$ is another Wiener process.

Complex-valued Wiener process

The complex-valued Wiener process may be defined as a complex-valued random process of the form $Z\_t\; =\; X\_t\; +\; mathrm\{i\}\; Y\_t$ where $X\_t,\; Y\_t$ are independent Wiener processes (real-valued).

Self-similarity

Brownian scaling, time reversal, time inversion: the same as in the real-valued case.

Rotation invariance: for every complex number "c" such that |"c"|=1 the process $c\; Z\_t$ is another complex-valued Wiener process.

Time change

If "f" is an entire function then the process $f(Z\_t)-f(0)$ is a time-changed complex-valued Wiener process.

Example. $Z\_t^2\; =\; (X\_t^2-Y\_t^2)\; +\; 2\; X\_t\; Y\_t\; mathrm\{i\}\; =\; U\_\{A(t)\}$ where $A(t)\; =\; 4\; int\_0^t\; |Z\_s|^2\; ,\; mathrm\{d\}\; s$ and $U$ is another complex-valued Wiener process.

In contrast to the real-valued case, a complex-valued martingale is generally not a time-changed complex-valued Wiener process. For example, the martingale $2\; X\_t\; +\; mathrm\{i\}\; Y\_t$ is not (here $X\_t,\; Y\_t$ are independent Wiener processes, as before).

ee also

* Abstract Wiener space
* Classical Wiener space
* Chernoff's distribution

References

* Kleinert, Hagen, "Path Integrals in Quantum Mechanics, Statistics, Polymer Physics, and Financial Markets", 4th edition, World Scientific (Singapore, 2004); Paperback ISBN 981-238-107-4 " (also available online: [http://www.physik.fu-berlin.de/~kleinert/b5 PDF-files] )"
* Henry Stark, John W. Woods, "Probability and Random Processes with Applications to Signal Processing", 3rd edition, Prentice Hall (New Jersey, 2002); Textbook ISBN 0-13-020071-9
* Richard Durrett, "Probability: theory and examples",second edition, 1996.
* Daniel Revuz and Marc Yor, "Continuous martingales and Brownian motion", second edition, Springer-Verlag 1994.